# Integrate.io: English ETL & Reverse ETL Knowledge Base ## Knowledge Base ### Getting Started - [ETL: Getting Started Guides Overview](https://www.integrate.io/docs/etl/category/getting-started.md): Browse Integrate.io ETL getting started guides covering connections, packages, clusters, jobs, package groups, terminology, and best practices. - [ETL: Getting Started](https://www.integrate.io/docs/etl/getting-started.md): Get started with Integrate.io ETL for cloud data integration. Learn the platform basics, create your first pipeline, and process data at scale. - [ETL: ETL Terminology](https://www.integrate.io/docs/etl/integrateio-etl-terminology.md): Learn the key terms and concepts used throughout Integrate.io ETL documentation, including packages, clusters, jobs, connections, and pipelines. - [ETL: Defining Connections](https://www.integrate.io/docs/etl/defining-connections.md): Create and manage data connections in Integrate.io ETL. Define access credentials for databases, cloud storage, APIs, and SaaS applications. - [ETL: Organize Connections with Connection Groups](https://www.integrate.io/docs/etl/connection-groups.md): Organize Integrate.io ETL connections into named groups to scope browsing, separate environments, and manage connections by team or project. - [ETL: Packages Overview](https://www.integrate.io/docs/etl/integrateio-etls-packages.md): Learn about Integrate.io ETL packages, the core building blocks for data pipelines. Understand package types, components, and design principles. - [ETL: Package Groups](https://www.integrate.io/docs/etl/package-groups.md): Learn about Integrate.io ETL package groups for organizing packages, connections, and team resources. Separate environments for your data projects. - [ETL: Clusters Overview](https://www.integrate.io/docs/etl/integrateio-etls-clusters.md): Learn about Integrate.io ETL clusters, the compute environments that run your data pipeline jobs. Understand cluster types, sizing, and lifecycle. - [ETL: Ask Helm](https://www.integrate.io/docs/etl/integrateio-ai-assistant.md): Ask Helm is the in-app AI assistant for Integrate.io ETL, with modes for answering documentation questions and building packages for you. - [ETL: Best Practices Guide](https://www.integrate.io/docs/etl/integrateio-best-practices-guide.md): Best practices for designing, scheduling, and operating Integrate.io ETL pipelines: package structure, performance tuning, error handling, and data quality. ### Packages & Workflows - [ETL: Packages & Workflows](https://www.integrate.io/docs/etl/category/packages-and-workflows.md): Create and manage ETL packages and workflows in Integrate.io. Use the visual designer, templates, version control, and workflow components. - [ETL: Creating a New Package](https://www.integrate.io/docs/etl/creating-a-new-package-in-integrateio-etl.md): Create a new data pipeline package in the Integrate.io ETL visual designer. Configure package settings, add components, and build data flows. - [ETL: Creating a Workflow](https://www.integrate.io/docs/etl/creating-a-workflow.md): Create workflow packages in Integrate.io ETL to orchestrate multi-step tasks. Define sequential and conditional task execution with error handling. - [ETL: Package Designer](https://www.integrate.io/docs/etl/working-in-the-new-package-designer.md): Use the Integrate.io ETL package designer to build and configure data pipelines visually. Edit package name, description, and component layout. - [ETL: Creating a Package from a Template](https://www.integrate.io/docs/etl/create-a-package-from-a-template.md): Create a new Integrate.io ETL package from a pre-built template. Choose from available templates to quickly start common data pipeline patterns. - [ETL: Package Creation Guide](https://www.integrate.io/docs/etl/creating-a-new-package.md): Create a new ETL package using the classic package creation flow in Integrate.io ETL. Configure package settings and define your data pipeline. - [ETL: Creating a Delivery](https://www.integrate.io/docs/etl/how-to-create-a-delivery.md): Create a data delivery pipeline in Integrate.io ETL. Configure source-to-destination data movement with scheduling and transformation options. - [ETL: Import or Export Package JSON](https://www.integrate.io/docs/etl/how-do-i-import-or-export-a-packages-json-source-code.md): Import or export package JSON source code in Integrate.io ETL. Use JSON export for version control, backup, and cross-account pipeline migration. - [ETL: Package Version Control](https://www.integrate.io/docs/etl/how-do-i-use-package-version-control.md): Use package version control in Integrate.io ETL to track changes, compare versions, and revert to previous package configurations when needed. - [ETL: Package Drafts](https://www.integrate.io/docs/etl/package-drafts.md): How package drafts autosave your unsaved changes in the package designer, per user, until you publish them with Save Version. - [ETL: Component Previewer](https://www.integrate.io/docs/etl/component-previewer.md): Use Component Previewer in Integrate.io ETL to test and preview data output from individual pipeline components before running a full job. - [ETL: Dynamic Connections](https://www.integrate.io/docs/etl/dynamic-connections.md): Use dynamic connections in Integrate.io ETL to parameterize data source and destination settings at runtime with variables and expressions. - [ETL: Advanced Search](https://www.integrate.io/docs/etl/advanced-search.md): Use advanced search modifiers in Integrate.io ETL to quickly find packages, connections, jobs, and other resources across your account workspace. - [ETL: Validating a Package](https://www.integrate.io/docs/etl/validating-a-package.md): Validate your Integrate.io ETL package before running it. Check for configuration errors, missing connections, and component issues automatically. - [ETL: Execute SQL](https://www.integrate.io/docs/etl/using-components-execute-sql-workflow.md): The Execute SQL workflow component runs a SQL statement as a step in your workflow. Use it to perform database operations between package executions. - [ETL: File Mover](https://www.integrate.io/docs/etl/using-components-file-mover-workflow.md): Configure the File Mover workflow component to move or rename files between storage locations as an automated step in your ETL workflow. - [ETL: Run Package](https://www.integrate.io/docs/etl/using-components-run-package-workflow.md): Use the Run Package workflow task to execute a dataflow as a step in your Integrate.io ETL workflow and pass variable overrides. - [ETL: Run Workflow](https://www.integrate.io/docs/etl/using-components-run-workflow.md): Use the Run Workflow task to execute another workflow as a sub-run inside an Integrate.io ETL workflow, with scoped variables and branching. - [ETL: PDF to CSV](https://www.integrate.io/docs/etl/using-components-pdf-to-csv-workflow.md): Configure the PDF to CSV workflow component to convert PDF files into CSV format as an automated step in your Integrate.io ETL workflow. ### Sources - [ETL: Sources](https://www.integrate.io/docs/etl/category/sources.md): Connect to data sources in Integrate.io ETL. Browse 150+ source connectors for databases, cloud storage, SaaS APIs, and file systems. - [ETL: Connecting to Amazon Athena](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-amazon-athena-instance.md): Connect Amazon Athena to Integrate.io ETL for querying data. Configure IAM access credentials, S3 output location, and connection settings. - [ETL: Connecting to Amazon RDS](https://www.integrate.io/docs/etl/allowing-integrateio-direct-access-to-relational-databases-on-amazon-web-services-rds.md): Grant Integrate.io ETL direct access to your Amazon RDS databases. Configure security groups and network settings for database connectivity. - [ETL: Amazon Redshift Source](https://www.integrate.io/docs/etl/using-components-amazon-redshift-source.md): Configure the Amazon Redshift source component to read data from Redshift tables and views in your Integrate.io ETL data pipeline. - [ETL: Amazon S3 Source](https://www.integrate.io/docs/etl/using-components-amazon-s3-source.md): How to connect to Amazon S3 and configure the S3 source component to read files in your Integrate.io ETL pipeline. - [ETL: Azure Blob Storage Source](https://www.integrate.io/docs/etl/using-components-azure-blob-storage-source.md): How to connect to Azure Blob Storage and configure the Azure Blob source component to read files in your Integrate.io ETL pipeline. - [ETL: Bing Ads Source](https://www.integrate.io/docs/etl/using-components-bing-ads-source.md): Configure the Bing Ads source component to read Microsoft Advertising report data in your Integrate.io ETL pipeline. Supports campaign metrics. - [ETL: Crisp Chat Source](https://www.integrate.io/docs/etl/using-components-crisp-chat-source.md): Configure the Crisp Chat source component in Integrate.io ETL to extract conversations, contacts, and chat events into your data pipelines and warehouse. - [ETL: Database Source](https://www.integrate.io/docs/etl/using-components-database-source.md): Configure the Database source to read data from PostgreSQL, MySQL, SQL Server, Oracle, or DB2 tables and views in your Integrate.io ETL pipeline. - [ETL: Connecting to DB2](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-db2-databases.md): Connect DB2 databases to Integrate.io ETL for reading and writing data. Configure access credentials, firewall rules, and connection settings. - [ETL: Dummy Source](https://www.integrate.io/docs/etl/using-components-dummy-source.md): Use the Dummy Source component to start a package that has no source data of its own, such as webhook-triggered or schedule-driven packages. - [ETL: Connecting to Dynamics 365](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-dynamics-365.md): Integrate.io ETL can access your Dynamics 365 data. This article details creating the Dynamics 365 connection in Integrate.io ETL. - [ETL: EDI (X12) Source](https://www.integrate.io/docs/etl/using-components-edi-x12-source.md): Configure the EDI (X12) source to read ASC X12 files from file storage, with optional flattening of 834 benefit enrollment files into tabular rows. - [ETL: Facebook Ads Insights Source](https://www.integrate.io/docs/etl/using-components-facebook-ads-insights-source.md): Configure the Facebook Ads Insights source component to read ad performance and campaign report data in your Integrate.io ETL data pipeline. - [ETL: File Storage Source](https://www.integrate.io/docs/etl/using-components-file-storage-source.md): Read files from Amazon S3, Google Cloud Storage, Azure Blob Storage, SFTP, FTPS, or HDFS. Each provider has its own source page. - [ETL: FTPS Source](https://www.integrate.io/docs/etl/using-components-ftps-source.md): How to connect to an FTPS server and configure the FTPS source component to read files in your Integrate.io ETL pipeline. - [ETL: Gmail Source](https://www.integrate.io/docs/etl/using-components-google-mail-gmail-source.md): Configure the Gmail source component in Integrate.io ETL to read CSV or Excel attachments and email body content from a Gmail inbox into your pipelines. - [ETL: Google Ads Source](https://www.integrate.io/docs/etl/using-components-google-ads-source.md): Configure the Google Ads source component to read advertising report data from your Google Ads account in Integrate.io ETL data pipelines. - [ETL: Google Analytics Source](https://www.integrate.io/docs/etl/using-components-google-analytics-source.md): Configure the Google Analytics source component to read web analytics report data from your GA account in Integrate.io ETL data pipelines. - [ETL: Google Analytics 4 (GA4) Source](https://www.integrate.io/docs/etl/using-components-google-analytics-4-ga4-source.md): Configure the Google Analytics 4 source component to read analytics report data from your GA4 property in Integrate.io ETL data pipelines. - [ETL: Google BigQuery Source](https://www.integrate.io/docs/etl/using-components-google-bigquery-source.md): Configure the Google BigQuery source component to read data from BigQuery tables or run queries in your Integrate.io ETL data pipeline. - [ETL: Google Cloud Spanner Source](https://www.integrate.io/docs/etl/using-components-google-cloud-spanner-source.md): Configure the Google Cloud Spanner source component to read data from Spanner tables or queries in your Integrate.io ETL data pipeline. - [ETL: Connecting to Google Cloud SQL for MySQL](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-google-cloud-sql-for-mysql-databases.md): Connect Google Cloud SQL for MySQL to Integrate.io ETL. Configure database access, firewall rules, and connection settings for data pipelines. - [ETL: Connecting to Google Cloud SQL for PostgreSQL](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-google-cloud-sql-for-postgresql-databases.md): Connect Google Cloud SQL for PostgreSQL to Integrate.io ETL. Configure access, firewall rules, and connection settings for data pipelines. - [ETL: Google Cloud Storage Source](https://www.integrate.io/docs/etl/using-components-google-cloud-storage-source.md): How to connect to Google Cloud Storage and configure the GCS source component to read files in your Integrate.io ETL pipeline. - [ETL: Connecting to Google Drive](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-google-drive.md): Integrate.io ETL can access your Google Drive data. This article details creating the Google Drive connection in Integrate.io ETL. - [ETL: Google Sheets Source](https://www.integrate.io/docs/etl/using-components-google-sheets-source.md): Configure the Google Sheets source component in Integrate.io ETL to read spreadsheet data with OAuth authentication, sheet selection, and cell range options. - [ETL: HDFS Source](https://www.integrate.io/docs/etl/using-components-hdfs-source.md): How to connect to HDFS and configure the Hadoop Distributed File System source component to read files in your Integrate.io ETL pipeline. - [ETL: Connecting to Heroku Postgres](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-heroku-postgres-databases.md): Connect Heroku Postgres to Integrate.io ETL for reading and writing data. Configure database credentials, SSL, and connection settings. - [ETL: HubSpot Source](https://www.integrate.io/docs/etl/using-components-hubspot-source.md): How to configure the HubSpot source component to read contacts, companies, deals, and custom objects in your Integrate.io ETL pipeline. - [ETL: Connecting to HubSpot](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-hubspot.md): Integrate.io ETL can load data to your HubSpot accounts. This article details creating the HubSpot connection in Integrate.io ETL. - [ETL: Connecting to HubSpot (Service Token)](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-hubspot-service-token.md): Connect Integrate.io ETL to HubSpot using a service token, configure API access, and load contacts, deals, and marketing data into your pipelines. - [ETL: Connecting to IBM i (AS/400)](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-ibm-i-as400.md): Connect IBM i (AS/400) databases to Integrate.io ETL for reading data. Configure JDBC access, firewall rules, and connection settings. - [ETL: Connecting to Instagram](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-instagram.md): Connect Instagram to Integrate.io ETL for extracting social media data. Set up the Facebook-Instagram OAuth connection for data pipelines. - [ETL: Connecting to Intercom](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-intercom.md): Connect Intercom to Integrate.io ETL for reading customer messaging data. Set up API credentials for both free and premium Intercom accounts. - [ETL: Connecting to LinkedIn](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-linkedin.md): Create a LinkedIn connection in Integrate.io ETL, authorize OAuth access, and build pipelines that read LinkedIn ads, pages, and profile data. - [ETL: Connecting to Marketing Cloud (REST)](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-marketing-cloud-rest.md): Connect Salesforce Marketing Cloud (REST API) to Integrate.io ETL. Configure API credentials and connection settings for data extraction. - [ETL: Connecting to Marketing Cloud (SOAP)](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-marketing-cloud-soap.md): Connect Salesforce Marketing Cloud (SOAP API) to Integrate.io ETL. Configure WSDL credentials and connection settings for data extraction. - [ETL: Connecting to Microsoft SQL Server](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-microsoft-sql-server-databases.md): Connect Microsoft SQL Server to Integrate.io ETL for reading and writing data. Configure firewall rules, credentials, and connection settings. - [ETL: MongoDB Source](https://www.integrate.io/docs/etl/using-components-mongodb-source.md): Configure the MongoDB source component to read data from MongoDB collections and run queries in your Integrate.io ETL data pipeline. - [ETL: Mouseflow Source](https://www.integrate.io/docs/etl/using-components-mouseflow-source.md): Configure the Mouseflow source component in Integrate.io ETL to read websites, recordings, funnels, forms, and feedback into your data pipeline. - [ETL: Connecting to MySQL](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-mysql-databases.md): Connect MySQL databases to Integrate.io ETL for reading and writing data. Configure user permissions, firewall rules, and connection settings. - [ETL: NetSuite Source](https://www.integrate.io/docs/etl/using-components-netsuite-source.md): Use the NetSuite source component to read NetSuite standard and custom records (tables) using the NetSuite JDBC drivers (SuiteAnalytics Connect). - [ETL: Ometria Source](https://www.integrate.io/docs/etl/using-components-ometria-source.md): How to configure the Ometria source component to read customer profiles, orders, products, and lists from the Ometria Data API in your Integrate.io ETL pipeline. - [ETL: Connecting to Oracle](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-oracle-databases.md): Connect Oracle databases to Integrate.io ETL for reading and writing data. Configure user permissions, firewall rules, and connection settings. - [ETL: Connecting to PostgreSQL](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-postgresql-databases.md): Connect PostgreSQL databases to Integrate.io ETL for reading and writing data. Configure permissions, firewall rules, and connection settings. - [ETL: REST API Source](https://www.integrate.io/docs/etl/using-components-rest-api-source.md): Configure the REST API source component to read data from HTTP endpoints and web services. Supports pagination and authentication methods. - [ETL: Salesforce Source](https://www.integrate.io/docs/etl/using-components-salesforce-source.md): Configure the Salesforce source to read standard and custom objects using the Bulk API. Supports SOQL queries and incremental data loading. - [ETL: Connecting to SAP HANA](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-sap-hana-databases.md): Connect SAP HANA databases to Integrate.io ETL for reading and writing data. Configure user permissions, firewall rules, and connection settings. - [ETL: SFTP Source](https://www.integrate.io/docs/etl/using-components-sftp-source.md): How to connect to an SFTP server and configure the SFTP source component to read files in your Integrate.io ETL pipeline. - [ETL: Connecting to SFTPToGo](https://www.integrate.io/docs/etl/allowing-access-to-my-file-data-on-sftptogo.md): Connect your SFTPToGo file storage to Integrate.io ETL. Set up SFTP credentials and access permissions for reading file data in pipelines. - [ETL: SharePoint Source](https://www.integrate.io/docs/etl/using-components-sharepoint-source.md): Configure the SharePoint source component in Integrate.io ETL to read documents and list items from Microsoft SharePoint into your data pipelines. - [ETL: Connecting to Shopify](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-shopify.md): Create a Shopify connection in Integrate.io ETL and build pipelines that read orders, products, customers, and inventory data into your warehouse. - [ETL: Snowflake Source](https://www.integrate.io/docs/etl/using-components-snowflake-source.md): Configure the Snowflake source component to read data from Snowflake tables and views in your Integrate.io ETL data pipeline for processing. - [ETL: SugarCRM Source](https://www.integrate.io/docs/etl/using-components-sugarcrm-source.md): How to configure the SugarCRM component to read CRM data (Accounts, Contacts, Leads, and custom modules) in your Integrate.io ETL pipeline. - [ETL: Connecting to TikTok Ads](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-tiktok-ads-data.md): Connect TikTok Ads to Integrate.io ETL for syncing advertising data. Configure API credentials and set up the TikTok Ads data connection. - [ETL: Trustpilot Source](https://www.integrate.io/docs/etl/using-components-trustpilot-source.md): How to configure the Trustpilot component to read service reviews and business categories in your Integrate.io ETL pipeline. - [ETL: Connecting via Universal OAuth](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-any-api-with-oauth.md): Set up a universal OAuth connection in Integrate.io ETL to access any REST API that supports OAuth 2.0 authentication for data extraction. - [ETL: Windows File Share Source](https://www.integrate.io/docs/etl/connecting-to-windows-file-share-source.md): Read files from a Windows file share (SMB/CIFS) in Integrate.io ETL using SFTP over a reverse SSH tunnel, with no inbound firewall rules. - [ETL: Connecting to Xero](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-xero.md): Connect Xero accounting data to Integrate.io ETL. Set up OAuth authorization and build a data pipeline for reading Xero financial records. - [ETL: Connecting to YouTube](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-data-on-youtube.md): Connect YouTube data to Integrate.io ETL. Set up Google OAuth authorization and configure a pipeline to read YouTube channel and video data. - [ETL: Zendesk Source](https://www.integrate.io/docs/etl/using-components-zendesk-source.md): Configure the Zendesk source component in Integrate.io ETL to read tickets, users, organizations, and other Zendesk objects into your pipeline. #### Snapshot CDC Sources - [ETL: Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-cdc-database-source.md): How Snapshot Change Data Capture source components work in Integrate.io ETL, with shared configuration, storage, and change detection reference for every supported database. - [ETL: MySQL Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-mysql-cdc-source.md): How to configure the MySQL Snapshot CDC source component to read changed records from MySQL in your Integrate.io ETL pipeline. - [ETL: PostgreSQL Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-postgresql-cdc-source.md): How to configure the PostgreSQL Snapshot CDC source component to read changed records from PostgreSQL in your Integrate.io ETL pipeline. - [ETL: SQL Server Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-sql-server-cdc-source.md): How to configure the SQL Server Snapshot CDC source component to read changed records from SQL Server in your Integrate.io ETL pipeline. - [ETL: Oracle Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-oracle-cdc-source.md): How to configure the Oracle Snapshot CDC source component to read changed records from Oracle in your Integrate.io ETL pipeline. - [ETL: Oracle ADW Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-oracle-adw-cdc-source.md): How to configure the Oracle ADW Snapshot CDC source component to read changed records from Oracle Autonomous Data Warehouse in your Integrate.io ETL pipeline. - [ETL: Amazon Redshift Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-amazon-redshift-cdc-source.md): How to configure the Amazon Redshift Snapshot CDC source component to read changed records from Redshift in your Integrate.io ETL pipeline. - [ETL: Snowflake Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-snowflake-cdc-source.md): How to configure the Snowflake Snapshot CDC source component to read changed records from Snowflake in your Integrate.io ETL pipeline. - [ETL: Google Cloud SQL Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-google-cloud-sql-cdc-source.md): How to configure the Google Cloud SQL Snapshot CDC source component to read changed records from Cloud SQL in your Integrate.io ETL pipeline. - [ETL: Google Cloud Postgres Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-google-cloud-postgres-cdc-source.md): How to configure the Google Cloud Postgres Snapshot CDC source component to read changed records from Cloud SQL for PostgreSQL in your Integrate.io ETL pipeline. - [ETL: Heroku Postgres Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-heroku-postgres-cdc-source.md): How to configure the Heroku Postgres Snapshot CDC source component to read changed records from Heroku Postgres in your Integrate.io ETL pipeline. - [ETL: AlloyDB Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-alloy-cdc-source.md): How to configure the AlloyDB Snapshot CDC source component to read changed records from AlloyDB in your Integrate.io ETL pipeline. - [ETL: Vertica Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-vertica-cdc-source.md): How to configure the Vertica Snapshot CDC source component to read changed records from Vertica in your Integrate.io ETL pipeline. - [ETL: Azure Synapse Analytics Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-azure-synapse-analytics-cdc-source.md): How to configure the Azure Synapse Analytics Snapshot CDC source component to read changed records from Synapse in your Integrate.io ETL pipeline. - [ETL: IBM DB2 Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-ibm-db2-cdc-source.md): How to configure the IBM DB2 Snapshot CDC source component to read changed records from DB2 in your Integrate.io ETL pipeline. - [ETL: SAP HANA Snapshot CDC Source](https://www.integrate.io/docs/etl/using-components-sap-hana-cdc-source.md): How to configure the SAP HANA Snapshot CDC source component to read changed records from SAP HANA in your Integrate.io ETL pipeline. #### Tutorials & Reference - [ETL: API Ingestion Guide](https://www.integrate.io/docs/etl/api-ingestion-guide-with-integrateio.md): Step-by-step guide to ingesting data from REST APIs using Integrate.io ETL. Configure API sources with authentication, pagination, and mapping. - [ETL: Ingesting a Postman API Call](https://www.integrate.io/docs/etl/ingesting-a-working-postman-api-call-with-integrateios-api-connector.md): Convert a working Postman API request into a REST source in Integrate.io ETL: map headers, auth, query parameters, and pagination into the API connector. - [ETL: Moving Data Incrementally Between Databases](https://www.integrate.io/docs/etl/how-do-i-move-data-incrementally-between-databases.md): This article guides you through the process of extracting and loading data incrementally from a database table to another database table. - [ETL: Reading File Storage Data Incrementally](https://www.integrate.io/docs/etl/how-do-i-read-data-from-file-storage-incrementally.md): Design incremental file-reading pipelines in Integrate.io ETL. Process only new or changed files from cloud storage on each scheduled job run. - [ETL: File Storage Options](https://www.integrate.io/docs/etl/file-storage-options.md): Common source and destination configuration options for file and object storage components in Integrate.io ETL. - [ETL: Salesforce Objects Reference](https://www.integrate.io/docs/etl/list-of-salesforce-objects.md): Reference list of supported Salesforce standard and custom objects for data extraction in Integrate.io ETL pipelines using the Salesforce source. - [ETL: Salesforce PK Chunking](https://www.integrate.io/docs/etl/salesforce-pk-chunking.md): Enable PK Chunking for large Salesforce data extractions in Integrate.io ETL. Improve query performance when extracting millions of records. - [ETL: Selecting File Input Format](https://www.integrate.io/docs/etl/how-do-i-select-my-file-input-format.md): Choose the correct file input format in the File Storage Source component. Configure record delimiters and record types for CSV, JSON, and more. - [ETL: API Endpoints with Pagination](https://www.integrate.io/docs/etl/api-endpoints-with-pagination-support.md): The following lists the API endpoints with pagination support that can be used with the Rest API Source or [C]CurlWithPagination functions. - [ETL: Pattern Matching in Source Paths](https://www.integrate.io/docs/etl/using-pattern-matching-in-source-component-paths.md): Use glob pattern matching in file storage source component paths to select multiple files. Supports wildcards and pattern-based file selection. - [ETL: Salesforce to SFTP Workflow](https://www.integrate.io/docs/etl/creating-an-api-managed-salesforce-to-sftp-workflow.md): Build an API-managed Salesforce-to-SFTP workflow in Integrate.io ETL using the REST API to programmatically run, monitor, and parameterize the pipeline. ### Transformations - [ETL: Transformations](https://www.integrate.io/docs/etl/category/transformations.md): Transform data in Integrate.io ETL pipelines. Use 20 built-in components to filter, join, aggregate, sort, pivot, and reshape data. - [ETL: Select Transformation](https://www.integrate.io/docs/etl/using-components-select-transformation.md): Configure the Select transformation in Integrate.io ETL to choose, rename, reorder, and compute fields with expressions before passing data downstream. - [ETL: Filter Transformation](https://www.integrate.io/docs/etl/using-components-filter-transformation.md): Use the Filter transformation to include or exclude records based on conditional expressions. Define rules to control data flow in pipelines. - [ETL: Join Transformation](https://www.integrate.io/docs/etl/using-components-join-transformation.md): Use the Join transformation to combine records from two inputs based on matching key fields. Supports inner, left, right, and full outer joins. - [ETL: Cross Join Transformation](https://www.integrate.io/docs/etl/using-components-cross-join-transformation.md): Use the Cross Join transformation to produce a Cartesian product by combining every record from two inputs in your ETL data pipeline. - [ETL: DB Lookup Transformation](https://www.integrate.io/docs/etl/using-components-db-lookup-transformation.md): Configure the ETL DB Lookup transformation to enrich pipeline records with columns from a database table or SQL query against a reference dataset. - [ETL: Union Transformation](https://www.integrate.io/docs/etl/using-components-union-transformation.md): Use the Union transformation to merge records from two inputs with identical schemas into a single output stream in your ETL data pipeline. - [ETL: Aggregate Transformation](https://www.integrate.io/docs/etl/using-components-aggregate-transformation.md): Use the Aggregate transformation to group data by fields and apply functions like Count, Average, Min, and Max in your ETL pipeline. - [ETL: Distinct Transformation](https://www.integrate.io/docs/etl/using-components-distinct-transformation.md): Use the Distinct transformation to remove duplicate records from your data, keeping only unique rows based on all field values in ETL pipelines. - [ETL: Sort Transformation](https://www.integrate.io/docs/etl/using-components-sort-transformation.md): Use the Sort transformation to order records by one or more fields in ascending or descending order in your Integrate.io ETL data pipeline. - [ETL: Rank Transformation](https://www.integrate.io/docs/etl/using-components-rank-transformation.md): Use the Rank component to sort input data by one or more fields, in an ascending or descending order and add a rank field that reflects the sort order. - [ETL: Window Transformation](https://www.integrate.io/docs/etl/using-components-window-transformation.md): Use the Window transformation to apply SQL-style window functions like ranking, moving averages, and running totals to your ETL pipeline data. - [ETL: Limit Transformation](https://www.integrate.io/docs/etl/using-components-limit-transformation.md): Use the Limit transformation to cap output records globally or per partition. Get top-N items, remove duplicates, or subset data for testing. - [ETL: Sample Transformation](https://www.integrate.io/docs/etl/using-components-sample-transformation.md): Use the Sample transformation to return a random percentage of input records for testing or data sampling in your Integrate.io ETL pipeline. - [ETL: Clone Transformation](https://www.integrate.io/docs/etl/using-components-clone-transformation.md): Use the Clone component to split a dataflow into two (or more) dataflows in order to apply multiple transformations to the same data. - [ETL: Assert Transformation](https://www.integrate.io/docs/etl/using-components-assert-transformation.md): Use the Assert transformation to validate that all records meet specified conditions. Non-compliant records cause the ETL job to fail with errors. - [ETL: Cube Transformation](https://www.integrate.io/docs/etl/using-components-cube-transformation.md): Use the Cube and Rollup transformation to group data by field combinations and apply aggregate functions like Count, Average, Min, and Max. - [ETL: AI Transformation](https://www.integrate.io/docs/etl/using-components-ai-transformation.md): Use the AI Transformation to apply LLM-powered data processing to fields in your Integrate.io ETL pipeline. Supports custom prompts and models. - [ETL: API Call Transformation](https://www.integrate.io/docs/etl/using-components-api-call-transformation.md): How to configure the API Call transformation to enrich pipeline rows with data from an HTTP API in your Integrate.io ETL pipeline. - [ETL: Python Transformation](https://www.integrate.io/docs/etl/using-components-python-transformation.md): Use the Python Transformation to run custom Python code for data processing as part of your Integrate.io ETL pipeline. Supports pandas. - [ETL: Pivot Transformation](https://www.integrate.io/docs/etl/using-components-pivot-transformation.md): Use the Pivot transformation to transpose rows into columns, converting unique field values into separate output columns in ETL pipelines. - [ETL: Unpivot Transformation](https://www.integrate.io/docs/etl/using-components-unpivot-transformation.md): Use the Unpivot transformation to transpose columns into rows, converting multiple columns into key-value pairs in your ETL data pipeline. ### Expressions & Functions - [ETL: Expressions & Functions](https://www.integrate.io/docs/etl/category/expressions-and-functions.md): Write expressions and use 180+ built-in functions in Integrate.io ETL for string manipulation, date handling, math, JSON/XML processing, and encryption. - [ETL: Functions Reference](https://www.integrate.io/docs/etl/integrateio-etl-functions.md): Complete reference of all built-in functions in Integrate.io ETL expressions, covering string, math, date, hash, collection, and API functions. - [ETL: Using Expressions](https://www.integrate.io/docs/etl/using-expressions-in-integrateio-etl.md): Learn how to write and use expressions in Integrate.io ETL pipelines. Build formulas with functions, operators, and field references in components. - [ETL: Using and Setting Variables](https://www.integrate.io/docs/etl/using-and-setting-variables-in-your-packages.md): Define, set, and use variables in Integrate.io ETL packages. Pass runtime parameters to jobs and reference dynamic values in your expressions. - [ETL: Global Variables](https://www.integrate.io/docs/etl/global-variables-account-level.md): Define and manage global variables at the account level in Integrate.io ETL. Share reusable variable values across all packages in your account. - [ETL: Global Secrets](https://www.integrate.io/docs/etl/global-secrets-account-level.md): Define and manage encrypted, account-level secrets in Integrate.io ETL and reuse them securely across all packages in your account. - [ETL: PGP Keys](https://www.integrate.io/docs/etl/pgp-keys-account-level.md): Store OpenPGP key material once at the account level and reference it by id from any File Storage source or destination to decrypt inbound files or encrypt outbound files. - [ETL: System and Pre-Defined Variables](https://www.integrate.io/docs/etl/system-and-pre-defined-variables.md): Reference for system and pre-defined variables in Integrate.io ETL expressions. Access job ID, package name, cluster info, and runtime metadata. - [ETL: ISO 8601 String Functions](https://www.integrate.io/docs/etl/using-iso-8601-string-functions.md): Guide to using ISO 8601 datetime string functions in Integrate.io ETL. Parse, format, truncate, and manipulate ISO dates in pipeline expressions. - [ETL: Encrypting and Decrypting Data](https://www.integrate.io/docs/etl/how-do-i-encrypt-and-decrypt-sensitive-data.md): Encrypt and decrypt sensitive fields in Integrate.io ETL pipelines using AWS Key Management Service (KMS) for field-level data protection. - [ETL: Processing JSON Data](https://www.integrate.io/docs/etl/how-do-i-process-json-data.md): Parse, extract, and transform JSON data in Integrate.io ETL pipelines using built-in functions like JsonExtract, JsonStringToMap, and ToBag. - [ETL: Processing XML Data](https://www.integrate.io/docs/etl/how-do-i-process-xml-data.md): Parse, extract, and transform XML data in Integrate.io ETL pipelines using XPath expressions and built-in XML processing functions like XPath. - [ETL: Processing Different Encodings](https://www.integrate.io/docs/etl/how-do-i-process-a-different-encoding.md): Process source files with non-UTF-8 character encodings in Integrate.io ETL by configuring the encoding option to read CSV, TSV, and text files correctly. - [ETL: Working with Datetime Data](https://www.integrate.io/docs/etl/how-do-i-work-with-datetime-data.md): Work with date and time data in Integrate.io ETL pipelines. Parse, format, convert, and calculate datetime values using built-in ETL functions. - [ETL: Date Time Converter](https://www.integrate.io/docs/etl/datetime-converter.md): How to use the Date Time Converter guided form in the Expression Editor to build date and time conversion expressions without writing them by hand. #### Functions A to Z - [ETL: ABS](https://www.integrate.io/docs/etl/abs.md): Calculate the absolute value of any numeric expression in your ETL pipeline. Useful for distance calculations and data normalization tasks. - [ETL: ACOS](https://www.integrate.io/docs/etl/acos.md): Compute the arc cosine (inverse cosine) of a numeric value in radians. Use for trigonometric calculations in ETL data transformations. - [ETL: AddDuration](https://www.integrate.io/docs/etl/addduration.md): Add a duration string expression to a datetime value and return the resulting datetime. Use ADDDURATION for date arithmetic in ETL pipelines. - [ETL: AddToDate](https://www.integrate.io/docs/etl/addtodate.md): Add or subtract years, months, days, hours, minutes, or seconds from a datetime value in Integrate.io ETL expressions for date arithmetic. - [ETL: ASIN](https://www.integrate.io/docs/etl/asin.md): Compute the arc sine (inverse sine) of a numeric value in radians. Use ASIN for trigonometric calculations in ETL data transformations. - [ETL: ATAN](https://www.integrate.io/docs/etl/atan.md): Compute the arc tangent (inverse tangent) of a numeric value in radians. Use ATAN for trigonometric calculations in ETL data transformations. - [ETL: BagToString](https://www.integrate.io/docs/etl/bagtostring.md): Join all elements of a bag (array) into a single string with an optional delimiter character. Defaults to underscore if delimiter is omitted. - [ETL: BagToTuple](https://www.integrate.io/docs/etl/bagtotuple.md): Flatten a bag (array) into a tuple structure so individual items can be referenced by position. Use for data restructuring in ETL pipelines. - [ETL: Base64Decode](https://www.integrate.io/docs/etl/base64decode.md): Decode a Base64-encoded string into a byte array in your ETL pipeline. Use BASE64DECODE for processing encoded binary data in transformations. - [ETL: Base64DecodeToString](https://www.integrate.io/docs/etl/base64decodetostring.md): Decode a Base64-encoded string directly into readable text with a specified character encoding. Use for text decoding in ETL data pipelines. - [ETL: Base64Encode](https://www.integrate.io/docs/etl/base64encode.md): Encode a byte array into Base64 format for safe text transmission. Use BASE64ENCODE for encoding binary data in Integrate.io ETL pipelines. - [ETL: Base64EncodeToString](https://www.integrate.io/docs/etl/base64encodetostring.md): Encode a byte array into a Base64 string using the standard encoding scheme. Use for preparing binary data for API calls in ETL pipelines. - [ETL: BinaryCCurl](https://www.integrate.io/docs/etl/binaryccurl.md): Makes a REST API call and returns the binary response received from the server. Requests are authenticated using an Integrate.io ETL connection. - [ETL: BinaryCurl](https://www.integrate.io/docs/etl/binarycurl.md): Makes a REST API call and returns the binary response received from the server. Requests are made either anonymous or with basic authentication. - [ETL: BrowserFamily](https://www.integrate.io/docs/etl/browserfamily.md): Extract the browser family name (Chrome, Firefox, Safari) from a user agent string using ua_parser. For web analytics in ETL data pipelines. - [ETL: BrowserFullName](https://www.integrate.io/docs/etl/browserfullname.md): Extract the full browser name and version string from a user agent string using ua_parser. Use for web analytics in ETL data pipelines. - [ETL: BrowserMajor](https://www.integrate.io/docs/etl/browsermajor.md): Extract the browser major version number from a user agent string using the ua_parser library. Use for browser analytics in ETL data pipelines. - [ETL: BrowserMinor](https://www.integrate.io/docs/etl/browserminor.md): Extract the browser minor version number from a user agent string using the ua_parser library. Use for browser analytics in ETL data pipelines. - [ETL: BrowserPatch](https://www.integrate.io/docs/etl/browserpatch.md): Extract the browser patch or build number from a user agent string using the ua_parser library. Use for detailed browser analysis in ETL jobs. - [ETL: BrowserVersion](https://www.integrate.io/docs/etl/browserversion.md): Extract the complete browser version string from a user agent string using the ua_parser library. Use for browser reporting in ETL pipelines. - [ETL: ByteArrayToString](https://www.integrate.io/docs/etl/bytearraytostring.md): Convert a byte array with a specified character encoding into a readable string. Use for binary-to-text conversions in ETL data pipelines. - [ETL: CBRT](https://www.integrate.io/docs/etl/cbrt.md): Calculate the cube root of a numeric expression in your Integrate.io ETL pipeline. Returns the cube root value for mathematical transformations. - [ETL: CCurl](https://www.integrate.io/docs/etl/ccurl.md): Makes a REST API call and returns the response received from the server. Requests are authenticated using an Integrate.io ETL connection. - [ETL: CCurlPoll](https://www.integrate.io/docs/etl/ccurlpoll.md): Continuously poll an authenticated REST API endpoint until a regex pattern matches the response or a timeout is reached. For async API workflows. - [ETL: CCurlWithPagination](https://www.integrate.io/docs/etl/ccurlwithpagination.md): Make authenticated, paginated REST API calls and aggregate responses from all pages into one result. For multi-page API ingestion with credentials. - [ETL: CEIL](https://www.integrate.io/docs/etl/ceil.md): Round a numeric expression up to the nearest integer value. Use CEIL for ceiling calculations in Integrate.io ETL data pipeline expressions. - [ETL: CityNameFromIP](https://www.integrate.io/docs/etl/citynamefromip.md): Look up and return the city name associated with an IPv4 address in dot-decimal notation. Use for IP-based geolocation in ETL data pipelines. - [ETL: ClockTime](https://www.integrate.io/docs/etl/clocktime.md): Return the current UTC datetime at the moment each individual record is processed. Use CLOCKTIME for per-record timestamps in ETL pipeline jobs. - [ETL: COALESCE](https://www.integrate.io/docs/etl/coalesce.md): Return the first non-null argument from a list of expressions. Use COALESCE for null handling and providing default values in ETL pipelines. - [ETL: CONCAT](https://www.integrate.io/docs/etl/concat.md): Join a variable number of string expressions into one combined string. Use CONCAT for building composite fields in Integrate.io ETL pipelines. - [ETL: ContinentCodeFromIP](https://www.integrate.io/docs/etl/continentcodefromip.md): Look up and return the two-letter continent code for an IPv4 address in dot-decimal notation. Use for geo-analysis in ETL data pipelines. - [ETL: ContinentNameFromIP](https://www.integrate.io/docs/etl/continentnamefromip.md): Look up and return the continent name for an IPv4 address in dot-decimal notation. Use for geographic analysis in Integrate.io ETL pipelines. - [ETL: COS](https://www.integrate.io/docs/etl/cos.md): Calculate the trigonometric cosine of a numeric input value in radians. Use COS for geometric and mathematical computations in ETL pipelines. - [ETL: COSH](https://www.integrate.io/docs/etl/cosh.md): Calculate the hyperbolic cosine of a numeric value in your ETL pipeline. Use COSH for advanced mathematical computations and data transformations. - [ETL: CountryCodeFromIP](https://www.integrate.io/docs/etl/countrycodefromip.md): Look up and return the ISO 3166-1 alpha-2 country code for an IPv4 address. Use for geographic segmentation in Integrate.io ETL pipelines. - [ETL: CountryNameFromIP](https://www.integrate.io/docs/etl/countrynamefromip.md): Look up and return the country name for an IPv4 address in dot-decimal notation. Use COUNTRYNAMEFROMIP for geolocation in ETL data pipelines. - [ETL: CSVSPLIT](https://www.integrate.io/docs/etl/csvsplit.md): Parse a CSV-formatted string into a tuple by splitting on a field delimiter character. Use CSVSPLIT for inline CSV parsing in ETL pipelines. - [ETL: Curl](https://www.integrate.io/docs/etl/curl.md): Makes a REST API call and returns the response received from the server. Requests are made either anonymous or with basic authentication. - [ETL: CurlPoll](https://www.integrate.io/docs/etl/curlpoll.md): Continuously poll a REST API endpoint until a response matches a regex pattern or timeout. Use CURLPOLL for async API workflows in ETL jobs. - [ETL: CurlWithPagination function reference](https://www.integrate.io/docs/etl/curlwithpagination.md): Reference for the CurlWithPagination function. Make paginated REST API calls and combine all page responses into a single aggregated result. - [ETL: CurrentTime](https://www.integrate.io/docs/etl/currenttime.md): Return the UTC datetime value for when the current job was submitted. Use CURRENTTIME for consistent job-level timestamps across all records. - [ETL: DateDiffDays](https://www.integrate.io/docs/etl/datediffdays.md): Calculate the number of whole days between two datetime values. Use DATEDIFFDAYS for date-range calculations in Integrate.io ETL data pipelines. - [ETL: DateDiffHours](https://www.integrate.io/docs/etl/datediffhours.md): Calculate the number of whole hours between two datetime values. Use DATEDIFFHOURS for time-range analysis in Integrate.io ETL data pipelines. - [ETL: DateDiffMinutes](https://www.integrate.io/docs/etl/datediffminutes.md): Calculate the number of whole minutes between two datetime values. Use DATEDIFFMINUTES for duration calculations in Integrate.io ETL pipelines. - [ETL: DateDiffMonths](https://www.integrate.io/docs/etl/datediffmonths.md): Calculate the number of whole months between two datetime values. Use DATEDIFFMONTHS for period calculations in Integrate.io ETL data pipelines. - [ETL: DateDiffSeconds](https://www.integrate.io/docs/etl/datediffseconds.md): Calculate the number of whole seconds between two datetime values. Use DATEDIFFSECONDS for precise duration analysis in ETL data pipelines. - [ETL: DateDiffYears](https://www.integrate.io/docs/etl/datediffyears.md): Calculate the number of whole years between two datetime values. Use DATEDIFFYEARS for age and tenure calculations in Integrate.io ETL pipelines. - [ETL: DateToExcelSerial](https://www.integrate.io/docs/etl/datetoexcelserial.md): Convert a datetime value to an Excel serial date number (1900 date system). Use when writing data to spreadsheets that expect numeric date serials. - [ETL: DaysBetween](https://www.integrate.io/docs/etl/daysbetween.md): Calculate the number of days between two datetime values using a fractional rounding approach. Compare with DATEDIFFDAYS for different behavior. - [ETL: Decrypt](https://www.integrate.io/docs/etl/decrypt.md): Decrypt an Integrate.io ETL encrypted string using the specified AWS KMS key ARN and the encryption context used for the encryption. - [ETL: DeviceFamily](https://www.integrate.io/docs/etl/devicefamily.md): Extract the device family name (iPhone, iPad, Galaxy) from a user agent string using ua_parser. Use for device analytics in ETL data pipelines. - [ETL: DistInMilesHaversine](https://www.integrate.io/docs/etl/distinmileshaversine.md): Compute the distance in miles between two latitude-longitude coordinate pairs using the Haversine formula. Use for geo-distance in ETL pipelines. - [ETL: Encrypt](https://www.integrate.io/docs/etl/encrypt.md): AES-encrypt a string using a specified AWS KMS key ARN and encryption context. Use ENCRYPT for protecting sensitive fields in ETL data pipelines. - [ETL: ExcelSerialToDate](https://www.integrate.io/docs/etl/excelserialtodate.md): Convert an Excel serial date number (1900 date system) to a UTC datetime value. Use when ingesting spreadsheet exports that store dates as numbers. - [ETL: ExecuteBQInsert](https://www.integrate.io/docs/etl/executebqinsert.md): Run a query job in Google BigQuery and write the results to a destination table. Use EXECUTEBQINSERT for in-pipeline BigQuery write operations. - [ETL: ExecuteSqlBoolean](https://www.integrate.io/docs/etl/executesqlboolean.md): Execute a SQL query that returns a scalar boolean value. If the query returns a dataset, the value of the first column in the first row is returned. - [ETL: ExecuteSqlDateTime](https://www.integrate.io/docs/etl/executesqldatetime.md): Execute a SQL query that returns a scalar datetime value. If the query returns a dataset, the value of the first column in the first row is returned. - [ETL: ExecuteSqlDouble](https://www.integrate.io/docs/etl/executesqldouble.md): Execute a SQL query that returns a scalar double value. If the query returns a dataset, the value of the first column in the first row is returned. - [ETL: ExecuteSqlFloat](https://www.integrate.io/docs/etl/executesqlfloat.md): Execute a SQL query that returns a scalar float value. If the query returns a dataset, the value of the first column in the first row is returned. - [ETL: ExecuteSqlInt](https://www.integrate.io/docs/etl/executesqlint.md): Execute a SQL query that returns a scalar integer value. If the query returns a dataset, the value of the first column in the first row is returned. - [ETL: ExecuteSqlLong](https://www.integrate.io/docs/etl/executesqllong.md): Execute a SQL query that returns a scalar long value. If the query returns a dataset, the value of the first column in the first row is returned. - [ETL: ExecuteSqlNonQuery](https://www.integrate.io/docs/etl/executesqlnonquery.md): Execute SQL DML or DDL statements that modify data or database schema without returning results. Use for in-pipeline database operations in ETL. - [ETL: ExecuteSqlString](https://www.integrate.io/docs/etl/executesqlstring.md): Execute a SQL query that returns a scalar string value. If the query returns a dataset, the value of the first column in the first row is returned. - [ETL: EXP](https://www.integrate.io/docs/etl/exp.md): Calculate Euler's number (e) raised to the power of the input expression. Use EXP for exponential growth and decay calculations in ETL jobs. - [ETL: ExtractQueryStringParam](https://www.integrate.io/docs/etl/extractquerystringparam.md): Extract the value of a specific query string parameter from a URL field. Use for URL parsing and web analytics processing in ETL data pipelines. - [ETL: ExtractSearchQuery](https://www.integrate.io/docs/etl/extractsearchquery.md): Extract the search query keywords from a search engine URL. Use EXTRACTSEARCHQUERY for search analytics data processing in ETL data pipelines. - [ETL: ExtractUABrowserID](https://www.integrate.io/docs/etl/extractuabrowserid.md): Return a unique browser identifier from a user agent string. Use EXTRACTUABROWSERID for visitor tracking and web analytics in ETL data pipelines. - [ETL: ExtractUABrowserName](https://www.integrate.io/docs/etl/extractuabrowsername.md): Return the browser name from a user agent string. Use EXTRACTUABROWSERNAME for web analytics and browser usage reporting in ETL data pipelines. - [ETL: ExtractUrlPart](https://www.integrate.io/docs/etl/extracturlpart.md): Extract a specific component (host, path, port, query) from a URL field. Use EXTRACTURLPART for URL parsing and analysis in ETL pipelines. - [ETL: Flatten](https://www.integrate.io/docs/etl/flatten.md): Flatten removes a level of nesting in a record. The result of applying Flatten to a bag is that each item in the bag will appear in a record of its own. - [ETL: FLOOR](https://www.integrate.io/docs/etl/floor.md): Round a numeric expression down to the nearest integer value. Use FLOOR for truncating decimal values in Integrate.io ETL pipeline expressions. - [ETL: FUZZY_MATCH](https://www.integrate.io/docs/etl/fuzzy-match.md): Compare two strings and return a 0–100 similarity score in Integrate.io ETL expressions for fuzzy filters, dedupe, and approximate record matching. - [ETL: GetBytes](https://www.integrate.io/docs/etl/getbytes.md): Convert a string input to its byte array representation in a given character encoding. Use GETBYTES for binary data handling in ETL pipelines. - [ETL: GetDay](https://www.integrate.io/docs/etl/getday.md): Extract the day-of-month component (1 through 31) from a datetime expression. Use GETDAY for date-based filtering and grouping in ETL pipelines. - [ETL: GetHour](https://www.integrate.io/docs/etl/gethour.md): Extract the hour component (0 through 23) from a datetime expression. Use GETHOUR for time-based filtering and data grouping in ETL pipelines. - [ETL: GetMilliSecond](https://www.integrate.io/docs/etl/getmillisecond.md): Extract the millisecond component from a datetime expression. Use GETMILLISECOND for sub-second precision timing in Integrate.io ETL pipelines. - [ETL: GetMinute](https://www.integrate.io/docs/etl/getminute.md): Extract the minute component (0 through 59) from a datetime expression. Use GETMINUTE for time-based grouping in Integrate.io ETL data pipelines. - [ETL: GetMonth](https://www.integrate.io/docs/etl/getmonth.md): Extract the month component (1 through 12) from a datetime expression. Use GETMONTH for monthly aggregations in Integrate.io ETL data pipelines. - [ETL: GetSecond](https://www.integrate.io/docs/etl/getsecond.md): Extract the second component (0 through 59) from a datetime expression. Use GETSECOND for time-based analysis in Integrate.io ETL data pipelines. - [ETL: GetWeek](https://www.integrate.io/docs/etl/getweek.md): Extract the ISO week-of-year number from a datetime expression. Use GETWEEK for weekly reporting and data grouping in ETL pipeline expressions. - [ETL: GetWeekYear](https://www.integrate.io/docs/etl/getweekyear.md): Extract the ISO week-year value from a datetime expression. Use GETWEEKYEAR for week-based date calculations in Integrate.io ETL data pipelines. - [ETL: GetYear](https://www.integrate.io/docs/etl/getyear.md): Extract the year component from a datetime expression. Use GETYEAR for annual aggregations, filtering, and date partitioning in ETL pipelines. - [ETL: HoursBetween](https://www.integrate.io/docs/etl/hoursbetween.md): Calculate the number of hours between two datetime values using a fractional rounding approach. Compare with DATEDIFFHOURS for alternate behavior. - [ETL: INDEXOF](https://www.integrate.io/docs/etl/indexof.md): Find the position of the first occurrence of a substring within a string, searching forward from an optional start index. Returns -1 if not found. - [ETL: INITCAP](https://www.integrate.io/docs/etl/initcap.md): Capitalize the first letter of each word in a string and lowercase the rest. Word delimiters include whitespace, hyphen, apostrophe, and period. - [ETL: IntervalIntersection](https://www.integrate.io/docs/etl/intervalintersection.md): Calculate the overlap duration in milliseconds between multiple date/time intervals. Use for scheduling and time range analysis in ETL pipelines. - [ETL: IsBase64](https://www.integrate.io/docs/etl/isbase64.md): Check whether a string expression is valid Base64-encoded content. Returns true or false for input validation in Integrate.io ETL data pipelines. - [ETL: IsEmpty](https://www.integrate.io/docs/etl/isempty.md): Check if a map or bag is empty, returning true, false, or null accordingly. Use ISEMPTY for conditional logic and data validation in ETL pipelines. - [ETL: IsISODatetime](https://www.integrate.io/docs/etl/isisodatetime.md): Check whether a string expression conforms to ISO 8601 date time format. Returns true or false for date validation in Integrate.io ETL pipelines. - [ETL: ISOAddDuration](https://www.integrate.io/docs/etl/isoaddduration.md): Add an ISO 8601 duration expression to an ISO datetime string and return the updated result. Use for date arithmetic in ETL pipeline expressions. - [ETL: ISODatetimeToString](https://www.integrate.io/docs/etl/isodatetimetostring.md): Format an ISO datetime string using a custom date format pattern. Use ISODATETIMETOSTRING for converting dates to display formats in ETL jobs. - [ETL: ISODatetimeToTimestampFormat](https://www.integrate.io/docs/etl/isodatetimetotimestampformat.md): Convert an ISO 8601 datetime string to JDBC timestamp format (yyyy-MM-dd HH:mm:ss). Use for database compatibility in ETL pipeline expressions. - [ETL: ISOSubtractDuration](https://www.integrate.io/docs/etl/isosubtractduration.md): Subtract an ISO 8601 duration from a datetime string and return the result. Use ISOSUBTRACTDURATION for date calculations in ETL data pipelines. - [ETL: ISOToDay](https://www.integrate.io/docs/etl/isotoday.md): Truncate an ISO datetime string to the start of its day (midnight UTC). Use ISOTODAY for daily grouping and aggregations in ETL data pipelines. - [ETL: ISOToHour](https://www.integrate.io/docs/etl/isotohour.md): Truncate an ISO datetime string to the start of its hour. Use ISOTOHOUR for hourly aggregations and time bucketing in ETL pipeline expressions. - [ETL: ISOToMinute](https://www.integrate.io/docs/etl/isotominute.md): Truncate an ISO datetime string to the start of its minute. Use ISOTOMINUTE for minute-level time groupings in Integrate.io ETL data pipelines. - [ETL: ISOToMonth](https://www.integrate.io/docs/etl/isotomonth.md): Truncate an ISO datetime string to the first day of its month. Use ISOTOMONTH for monthly aggregations in Integrate.io ETL pipeline expressions. - [ETL: ISOToSecond](https://www.integrate.io/docs/etl/isotosecond.md): Truncate an ISO datetime string to the start of its second. Use ISOTOSECOND for second-level precision groupings in ETL pipeline expressions. - [ETL: ISOToWeek](https://www.integrate.io/docs/etl/isotoweek.md): Truncate an ISO datetime string to Monday of its week. Use ISOTOWEEK for weekly aggregations and reporting in Integrate.io ETL data pipelines. - [ETL: ISOToYear](https://www.integrate.io/docs/etl/isotoyear.md): Truncate an ISO datetime string to January 1st of its year. Use ISOTOYEAR for yearly aggregations in Integrate.io ETL pipeline expressions. - [ETL: JsonExtract](https://www.integrate.io/docs/etl/jsonextract.md): Extracts the value referenced by a JSONPath-like expression json_path from a given JSON string and returns the result as a JSON string. - [ETL: JsonExtractScalar](https://www.integrate.io/docs/etl/jsonextractscalar.md): Extracts the value referenced by a JSONPath-like expression json_path from a given JSON string and returns the result as a string. - [ETL: JsonStringToBag](https://www.integrate.io/docs/etl/jsonstringtobag.md): Parse a JSON array string into a bag (array) data structure for iteration. Use JSONSTRINGTOBAG for JSON array processing in ETL data pipelines. - [ETL: JsonStringToMap](https://www.integrate.io/docs/etl/jsonstringtomap.md): Use the JsonStringToMap expression function in Integrate.io ETL to parse a JSON string into a map field for downstream transformations and field access. - [ETL: LAST_INDEX_OF](https://www.integrate.io/docs/etl/last-index-of.md): Returns the position of the last occurrence of a search string in a string field, when searching backward from the end of the string. - [ETL: LatitudeFromIP](https://www.integrate.io/docs/etl/latitudefromip.md): Look up and return the latitude coordinate for an IPv4 address in dot-decimal notation. Use for IP-based geolocation mapping in ETL pipelines. - [ETL: LCFIRST](https://www.integrate.io/docs/etl/lcfirst.md): Convert the first character of a string to lowercase while preserving the remaining characters. Use LCFIRST for text normalization in ETL jobs. - [ETL: Length](https://www.integrate.io/docs/etl/length.md): Return the number of characters in a string field value. Use LENGTH for measuring, validating, and filtering string data in ETL data pipelines. - [ETL: LOG](https://www.integrate.io/docs/etl/log.md): Compute the natural logarithm (base e) of a numeric value in your ETL pipeline. Use LOG for logarithmic data transformations and calculations. - [ETL: LOG10](https://www.integrate.io/docs/etl/log10.md): Compute the base-10 logarithm of a numeric value in your ETL pipeline. Use LOG10 for order-of-magnitude and decibel calculations in data flows. - [ETL: LongitudeFromIP](https://www.integrate.io/docs/etl/longitudefromip.md): Look up and return the longitude coordinate for an IPv4 address in dot-decimal notation. Use for IP-based geolocation mapping in ETL pipelines. - [ETL: LOWER](https://www.integrate.io/docs/etl/lower.md): Convert all characters in a string expression to lowercase. Use LOWER for case-insensitive matching and text normalization in ETL data pipelines. - [ETL: MapToBag](https://www.integrate.io/docs/etl/maptobag.md): Convert a map into a bag of key-value pair maps for iteration. Use MAPTOBAG for processing map entries in Integrate.io ETL pipeline expressions. - [ETL: MapToQueryString](https://www.integrate.io/docs/etl/maptoquerystring.md): Convert a key-value map into a URL query string format (key1=value1&key2=value2). Use for building URL parameters in Integrate.io ETL pipelines. - [ETL: MD2](https://www.integrate.io/docs/etl/md2.md): Calculate the MD2 message digest hash of a string value. Use MD2 for legacy checksum generation in Integrate.io ETL pipeline data processing. - [ETL: MD5](https://www.integrate.io/docs/etl/md5.md): Calculate the MD5 message digest hash of a string value. Use MD5 for checksums, data deduplication, and fingerprinting in ETL data pipelines. - [ETL: MilliSecondsBetween](https://www.integrate.io/docs/etl/millisecondsbetween.md): Calculate the number of milliseconds between two datetime values. Use MILLISECONDSBETWEEN for sub-second duration measurement in ETL data pipelines. - [ETL: MinutesBetween](https://www.integrate.io/docs/etl/minutesbetween.md): Calculate the number of minutes between two datetime values using a fractional rounding method. Compare with DATEDIFFMINUTES for other behavior. - [ETL: MonthsBetween](https://www.integrate.io/docs/etl/monthsbetween.md): Calculate the number of months between two datetime values using a fractional rounding method. Compare with DATEDIFFMONTHS for other approaches. - [ETL: NormalizeDate](https://www.integrate.io/docs/etl/normalizedate.md): Normalize a date or datetime string to an ISO 8601 date in Integrate.io ETL expressions for consistent storage, sorting, and downstream date processing. - [ETL: NormalizeLanguage](https://www.integrate.io/docs/etl/normalizelanguage.md): Normalize a language name or code to an ISO 639 language code in Integrate.io ETL expressions for consistent storage, deduplication, and downstream matching. - [ETL: NormalizePhone](https://www.integrate.io/docs/etl/normalizephone.md): Normalize a phone number string to E.164 format in Integrate.io ETL expressions for consistent storage, deduplication, and downstream matching. - [ETL: NormalizeState](https://www.integrate.io/docs/etl/normalizestate.md): Normalize a US state, territory, or DC name to its 2-letter USPS abbreviation in Integrate.io ETL expressions for consistent storage, deduplication, and downstream matching. - [ETL: OsFamily](https://www.integrate.io/docs/etl/osfamily.md): Extract the operating system family name (Windows, macOS, Linux) from a user agent string using ua_parser. For OS analytics in ETL pipelines. - [ETL: OsFullName](https://www.integrate.io/docs/etl/osfullname.md): Extract the full operating system name and version from a user agent string using ua_parser. Use for OS analytics in Integrate.io ETL pipelines. - [ETL: OsMajor](https://www.integrate.io/docs/etl/osmajor.md): Extract the operating system major version number from a user agent string using ua_parser. Use for OS version analysis in ETL data pipelines. - [ETL: OsMinor](https://www.integrate.io/docs/etl/osminor.md): Extract the operating system minor version number from a user agent string using ua_parser. Use for OS version analysis in ETL data pipelines. - [ETL: OsPatch](https://www.integrate.io/docs/etl/ospatch.md): Extract the operating system patch or build number from a user agent string using ua_parser. Use for detailed OS version tracking in ETL jobs. - [ETL: OsPatchMinor](https://www.integrate.io/docs/etl/ospatchminor.md): Extract the OS patch minor version number from a user agent string using ua_parser. Use for granular OS version tracking in ETL data pipelines. - [ETL: OsVersion](https://www.integrate.io/docs/etl/osversion.md): Extract the full operating system version string from a user agent string using ua_parser. Use for OS version reporting in ETL data pipelines. - [ETL: ParseDate](https://www.integrate.io/docs/etl/parsedate.md): Convert an input datetime string to a datetime data type using the first matching format from a list of patterns. Flexible date parsing for ETL. - [ETL: ParseDoubleOrDefault](https://www.integrate.io/docs/etl/parsedoubleordefault.md): Safely convert a string to a double-precision number, returning a default value on parse failure. Use for resilient numeric parsing in ETL jobs. - [ETL: ParseFloatOrDefault](https://www.integrate.io/docs/etl/parsefloatordefault.md): Safely convert a string to a floating-point number, returning a default value on failure. Use for error-tolerant numeric parsing in ETL pipelines. - [ETL: ParseIntOrDefault](https://www.integrate.io/docs/etl/parseintordefault.md): Safely convert a string to an integer, returning a specified default value if the conversion fails. Use for resilient numeric parsing in ETL jobs. - [ETL: ParseLongOrDefault](https://www.integrate.io/docs/etl/parselongordefault.md): Safely convert a string to a long integer, returning a default value if conversion fails. Use for resilient large number parsing in ETL pipelines. - [ETL: PlatformFamily](https://www.integrate.io/docs/etl/platformfamily.md): Extract the platform family or device category (mobile, desktop, tablet) from a user agent string. For device type analytics in ETL pipelines. - [ETL: POW](https://www.integrate.io/docs/etl/pow.md): Raise a numeric base value to the power of an exponent in your ETL pipeline. Use POW for exponential calculations and data transformations. - [ETL: QueryStringToMap](https://www.integrate.io/docs/etl/querystringtomap.md): Parse a URL query string (key1=value1&key2=value2) into a key-value map structure. Use for processing web URL parameters in ETL data pipelines. - [ETL: RANDOM](https://www.integrate.io/docs/etl/random.md): Generate a pseudo-random floating-point number between 0.0 and 1.0 in your ETL pipeline. Useful for sampling, testing, and data randomization. - [ETL: REGEX_EXTRACT](https://www.integrate.io/docs/etl/regex-extract.md): Extract matching text from a string using a regular expression, returning the nth occurrence by index. Use for pattern-based parsing in ETL jobs. - [ETL: REGEX_EXTRACT_ALL](https://www.integrate.io/docs/etl/regex-extract-all.md): Return all capture groups matched by a regular expression pattern as a tuple. Use REGEX_EXTRACT_ALL for multi-group regex parsing in ETL pipelines. - [ETL: REGEX_FIND_ALL](https://www.integrate.io/docs/etl/regex-find-all.md): Return all substrings matching a regular expression as a bag (array). Use REGEX_FIND_ALL for comprehensive pattern matching in ETL data pipelines. - [ETL: RegionCodeFromIP](https://www.integrate.io/docs/etl/regioncodefromip.md): Extracts the two character ISO-3166-2 (US or Canada) or FIPS 10-4 code for the state/region from a given IPv4 string (dot-decimal notation). - [ETL: RegionNameFromIP](https://www.integrate.io/docs/etl/regionnamefromip.md): Look up and return the region, state, or province name for an IPv4 address. Use REGIONNAMEFROMIP for geographic segmentation in ETL pipelines. - [ETL: REPLACE](https://www.integrate.io/docs/etl/replace.md): Replace all occurrences of a search substring with a new value in a string field. Use REPLACE for text cleanup and formatting in ETL pipelines. - [ETL: Reverse](https://www.integrate.io/docs/etl/reverse.md): Reverse the order of characters in a string field value. Use REVERSE for string manipulation, palindrome checks, and data transforms in ETL jobs. - [ETL: ROUND](https://www.integrate.io/docs/etl/round.md): Round a numeric expression to the nearest integer using standard math rounding rules. Use ROUND for numeric formatting in ETL data pipelines. - [ETL: ROUND_TO](https://www.integrate.io/docs/etl/round-to.md): Round a numeric expression to a specified number of decimal places. Use ROUND_TO for precision control and formatting in ETL pipeline expressions. - [ETL: SecondsBetween](https://www.integrate.io/docs/etl/secondsbetween.md): Calculate the number of seconds between two datetime values using a fractional rounding approach. Compare with DATEDIFFSECONDS for differences. - [ETL: SHA1](https://www.integrate.io/docs/etl/sha1.md): Calculate the SHA-1 cryptographic hash of a string value. Use SHA1 for checksums, data integrity verification, and fingerprinting in ETL jobs. - [ETL: SHA256](https://www.integrate.io/docs/etl/sha256.md): Calculate the SHA-256 cryptographic hash of a string value. Use SHA256 for secure hashing, data integrity, and token generation in ETL pipelines. - [ETL: SHA256WithRSA](https://www.integrate.io/docs/etl/sha256withrsa.md): Sign an input string with an RSA private key using SHA256withRSA. Use for JWT authentication and secure API integrations in ETL data pipelines. - [ETL: SHA384](https://www.integrate.io/docs/etl/sha384.md): Calculate the SHA-384 cryptographic hash of a string value. Use SHA384 for secure hashing and data integrity verification in ETL data pipelines. - [ETL: SHA512](https://www.integrate.io/docs/etl/sha512.md): Calculate the SHA-512 cryptographic hash of a string value. Use SHA512 for secure hashing and data integrity verification in ETL data pipelines. - [ETL: SIN](https://www.integrate.io/docs/etl/sin.md): Calculate the trigonometric sine of a numeric input value in radians. Use SIN for geometric and mathematical computations in ETL data pipelines. - [ETL: SINH](https://www.integrate.io/docs/etl/sinh.md): Calculate the hyperbolic sine of a numeric value in your ETL pipeline. Use SINH for advanced mathematical computations and data transformations. - [ETL: SIZE](https://www.integrate.io/docs/etl/size.md): Return the element count of a bag, tuple, or map, or the character length for strings. Use SIZE for data validation in ETL pipeline expressions. - [ETL: Sleep](https://www.integrate.io/docs/etl/sleep.md): Pause pipeline execution for a specified number of milliseconds. Use SLEEP to add delays between API calls or rate-limited operations in ETL jobs. - [ETL: SPRINTF](https://www.integrate.io/docs/etl/sprintf.md): Format values using printf-style templates with the Java formatter library. Use SPRINTF for custom string formatting in ETL pipeline expressions. - [ETL: SQRT](https://www.integrate.io/docs/etl/sqrt.md): Calculate the positive square root of a numeric expression in your ETL pipeline. Use SQRT for mathematical computations and data transformations. - [ETL: StringToISODatetime](https://www.integrate.io/docs/etl/stringtoisodatetime.md): Convert a non-ISO datetime string to ISO 8601 format using a specified format pattern. Use for date standardization in Integrate.io ETL pipelines. - [ETL: STRSPLIT](https://www.integrate.io/docs/etl/strsplit.md): Split a string into a tuple of substrings using a specified delimiter character. Use STRSPLIT for parsing delimited text data in ETL pipelines. - [ETL: STRSPLITTOBAG](https://www.integrate.io/docs/etl/strsplittobag.md): Split a string into a bag (array) of substrings using a specified delimiter. Use STRSPLITTOBAG for parsing multi-value fields in ETL data pipelines. - [ETL: SUBSTRING](https://www.integrate.io/docs/etl/substring.md): Extract a portion of a string field by specifying start position and optional length. Use SUBSTRING for text parsing in ETL pipeline expressions. - [ETL: SubtractDuration](https://www.integrate.io/docs/etl/subtractduration.md): Subtract a duration string expression from a datetime value and return the result. Use SUBTRACTDURATION for date arithmetic in ETL data pipelines. - [ETL: SwitchTimeZone](https://www.integrate.io/docs/etl/switchtimezone.md): Use the SwitchTimezone expression function in Integrate.io ETL to convert datetime values between time zones inside your pipeline transformations. - [ETL: TAN](https://www.integrate.io/docs/etl/tan.md): Calculate the trigonometric tangent of a numeric input in radians. Use TAN for geometric and mathematical computations in ETL pipeline expressions. - [ETL: TANH](https://www.integrate.io/docs/etl/tanh.md): Calculate the hyperbolic tangent of a numeric value in your ETL pipeline. Use TANH for sigmoid-like mathematical transformations in data processing. - [ETL: TimestampFormatToISODatetime](https://www.integrate.io/docs/etl/timestampformattoisodatetime.md): Convert a JDBC timestamp format string (yyyy-MM-dd HH:mm:ss) to ISO 8601 format. Use for date standardization in Integrate.io ETL pipelines. - [ETL: TOBAG](https://www.integrate.io/docs/etl/tobag.md): Convert one or more expressions into a bag (array) data type. Use TOBAG for creating collections from individual values in ETL data pipelines. - [ETL: ToDate](https://www.integrate.io/docs/etl/todate.md): Convert an input string to a datetime data type based on a specified format pattern. Use TODATE for date parsing in Integrate.io ETL pipelines. - [ETL: ToDateCustomFormats](https://www.integrate.io/docs/etl/todatecustomformats.md): Convert a datetime string to datetime data type using the first matching format from a list of custom patterns. Flexible date parsing for ETL jobs. - [ETL: ToDateOrNull](https://www.integrate.io/docs/etl/todateornull.md): Parse a datetime string with a single format and return null for missing or unmatched values in Integrate.io ETL expressions and pipelines. - [ETL: ToHexString](https://www.integrate.io/docs/etl/tohexstring.md): Convert an integer argument to its hexadecimal string representation in base 16. Use TOHEXSTRING for encoding and data formatting in ETL pipelines. - [ETL: ToJson](https://www.integrate.io/docs/etl/tojson.md): Serialize any input value into a JSON-formatted string. Use TOJSON for JSON output formatting and API payload construction in ETL data pipelines. - [ETL: TOKENIZE](https://www.integrate.io/docs/etl/tokenize.md): Use the Tokenize expression function in Integrate.io ETL to split a string into tokens by delimiter for parsing CSV-like fields and array transformations. - [ETL: TOMAP](https://www.integrate.io/docs/etl/tomap.md): Convert key-value expression pairs into a map data type structure. Use TOMAP for building lookup structures in Integrate.io ETL data pipelines. - [ETL: ToMilliSeconds](https://www.integrate.io/docs/etl/tomilliseconds.md): Convert a datetime value to the number of milliseconds elapsed since the Unix epoch (1970-01-01T00:00:00Z). Use for timestamp arithmetic in ETL. - [ETL: ToString](https://www.integrate.io/docs/etl/tostring.md): Convert a datetime field to an ISO-8601 string or a custom date format. Use TOSTRING for date formatting and output preparation in ETL pipelines. - [ETL: TOTUPLE](https://www.integrate.io/docs/etl/totuple.md): Convert one or more expressions into a tuple data type. Use TOTUPLE for grouping related values into structured records in ETL data pipelines. - [ETL: ToUnixTime](https://www.integrate.io/docs/etl/tounixtime.md): Convert a datetime value to Unix time (seconds since epoch). Use TOUNIXTIME for timestamp conversions and epoch calculations in ETL data pipelines. - [ETL: TRIM](https://www.integrate.io/docs/etl/trim.md): Remove leading and trailing whitespace characters from a string field value. Use TRIM for cleaning and normalizing imported text data in ETL jobs. - [ETL: UCFIRST](https://www.integrate.io/docs/etl/ucfirst.md): Convert the first character of a string to uppercase while preserving the remaining characters. Use UCFIRST for text formatting in ETL pipelines. - [ETL: UPPER](https://www.integrate.io/docs/etl/upper.md): Convert all characters in a string expression to uppercase. Use UPPER for case normalization and standardization in Integrate.io ETL data pipelines. - [ETL: URLDecode](https://www.integrate.io/docs/etl/urldecode.md): Decode a URL-encoded (percent-encoded) string back to its original form. Use URLDECODE for processing web data in Integrate.io ETL data pipelines. - [ETL: URLEncode](https://www.integrate.io/docs/etl/urlencode.md): Encode a string expression for safe use in URLs using percent encoding. Use URLENCODE for building API query parameters in ETL data pipelines. - [ETL: UUID](https://www.integrate.io/docs/etl/uuid.md): Generate a universally unique identifier (UUID) string value. Use UUID for creating unique record identifiers in Integrate.io ETL pipeline jobs. - [ETL: WeeksBetween](https://www.integrate.io/docs/etl/weeksbetween.md): Calculate the number of weeks between two datetime values. Use WEEKSBETWEEN for weekly period analysis and reporting in ETL pipeline expressions. - [ETL: XPath](https://www.integrate.io/docs/etl/xpath.md): Extract data from an XML document using an XPath expression. Use XPATH for XML parsing and data extraction in Integrate.io ETL data pipelines. - [ETL: XPathToBag](https://www.integrate.io/docs/etl/xpathtobag.md): Extract all matching nodes from an XML document as a bag using an XPath expression. Use XPATHTOBAG for XML array extraction in ETL data pipelines. - [ETL: YearsBetween](https://www.integrate.io/docs/etl/yearsbetween.md): Calculate the number of years between two datetime values using a fractional rounding approach. Compare with DATEDIFFYEARS for different behavior. ### Destinations - [ETL: Destinations](https://www.integrate.io/docs/etl/category/destinations.md): Load data to target systems in Integrate.io ETL. Configure destination connectors for Snowflake, Redshift, BigQuery, databases, and cloud storage. - [ETL: Amazon Redshift Destination](https://www.integrate.io/docs/etl/using-components-amazon-redshift-destination.md): Configure the Amazon Redshift destination component to write pipeline output data into Redshift tables in your Integrate.io ETL pipeline. - [ETL: Amazon S3 Destination](https://www.integrate.io/docs/etl/using-components-amazon-s3-destination.md): How to configure the Amazon S3 destination component to write files to an S3 bucket in your Integrate.io ETL pipeline. - [ETL: Azure Blob Storage Destination](https://www.integrate.io/docs/etl/using-components-azure-blob-storage-destination.md): How to configure the Azure Blob Storage destination component to write files to an Azure container in your Integrate.io ETL pipeline. - [ETL: Database Destination](https://www.integrate.io/docs/etl/using-components-database-destination.md): Configure the Database destination to write data into PostgreSQL, MySQL, SQL Server, Oracle, or DB2 tables in your Integrate.io ETL pipeline. - [ETL: Databricks Destination](https://www.integrate.io/docs/etl/using-components-databricks-destination.md): Configure the Databricks destination to load ETL pipeline output into Delta tables using S3 staging and the COPY INTO SQL command. - [ETL: Email Report Destination](https://www.integrate.io/docs/etl/using-components-email-report.md): How to configure the Email Report component to email pipeline results as a table, CSV, or text attachment in your Integrate.io ETL pipeline. - [ETL: Facebook Ads Destination](https://www.integrate.io/docs/etl/using-components-facebook-ads-destination.md): Use the Facebook destination component to store the output of a data flow in Facebook cloud object. The destination component uses Facebook ads API. - [ETL: File Storage Destination](https://www.integrate.io/docs/etl/using-components-file-storage-destination.md): Write data to Amazon S3, Google Cloud Storage, Azure Blob Storage, SFTP, FTPS, or HDFS. Each provider has its own destination page. - [ETL: Google Ads Destination](https://www.integrate.io/docs/etl/using-components-google-ads-destination.md): Use Google Ads destination component to store the output from data flow in Google Ads Object. The destination component uses Google Ads API. - [ETL: Google Cloud Storage Destination](https://www.integrate.io/docs/etl/using-components-google-cloud-storage-destination.md): How to configure the Google Cloud Storage destination component to write files to a GCS bucket in your Integrate.io ETL pipeline. - [ETL: FTPS Destination](https://www.integrate.io/docs/etl/using-components-ftps-destination.md): How to configure the FTPS destination component to write files to an FTPS server in your Integrate.io ETL pipeline. - [ETL: HDFS Destination](https://www.integrate.io/docs/etl/using-components-hdfs-destination.md): How to configure the HDFS destination component to write files to a Hadoop Distributed File System cluster in your Integrate.io ETL pipeline. - [ETL: SFTP Destination](https://www.integrate.io/docs/etl/using-components-sftp-destination.md): How to configure the SFTP destination component to write files to an SFTP server in your Integrate.io ETL pipeline. - [ETL: Google BigQuery Destination](https://www.integrate.io/docs/etl/using-components-google-bigquery-destination.md): Configure the Google BigQuery destination to write data flow output into BigQuery tables via Cloud Storage staging in your ETL data pipeline. - [ETL: Google Spanner Destination](https://www.integrate.io/docs/etl/using-components-google-spanner-destination.md): Configure the Google Cloud Spanner destination component to write data flow output into a Spanner table in your Integrate.io ETL pipeline. - [ETL: HubSpot Destination](https://www.integrate.io/docs/etl/using-components-hubspot-destination.md): Configure the HubSpot destination component to write data flow output into HubSpot CRM objects in your Integrate.io ETL data pipeline. - [ETL: MongoDB Destination](https://www.integrate.io/docs/etl/using-components-mongodb-destination.md): Configure the MongoDB destination component to write data flow output into a MongoDB collection in your Integrate.io ETL data pipeline. - [ETL: Netsuite SOAP Destination](https://www.integrate.io/docs/etl/using-components-netsuite-soap-destination.md): Configure the NetSuite SOAP destination component to write data into NetSuite objects via the SOAP API in your Integrate.io ETL pipeline. - [ETL: Ometria Destination](https://www.integrate.io/docs/etl/using-components-ometria-destination.md): Push contacts, orders, and custom events to the Ometria /v2/push endpoint from an Integrate.io ETL pipeline. - [ETL: Salesforce Bulk API Destination](https://www.integrate.io/docs/etl/using-components-salesforce-destination.md): Configure the Salesforce Bulk API destination to write data into Salesforce Sales Cloud objects via the Bulk API in your Integrate.io ETL data pipeline. - [ETL: Salesforce Data Cloud Destination](https://www.integrate.io/docs/etl/using-components-salesforce-data-cloud-destination.md): Configure the Salesforce Data Cloud destination to load records into Data Cloud objects through the Ingestion API bulk pattern. - [ETL: Salesforce REST API Destination](https://www.integrate.io/docs/etl/using-components-salesforce-rest-destination.md): Configure the Salesforce REST API destination to write records to Salesforce Sales Cloud objects with per-record success and failure outputs. - [ETL: REST API Destination](https://www.integrate.io/docs/etl/using-components-rest-api-destination.md): Configure the REST API destination component in Integrate.io ETL to send pipeline data to any HTTP endpoint with custom headers, auth, and batching. - [ETL: Snowflake Destination](https://www.integrate.io/docs/etl/using-components-snowflake-destination.md): Configure the Snowflake destination to write data into Snowflake tables via S3 staging and the COPY command in your Integrate.io ETL pipeline. - [ETL: TikTok Ads Destination](https://www.integrate.io/docs/etl/using-components-tiktok-ads-destination.md): Use the TiktokAds destination component to store the output of a data flow in TiktokAds cloud object. The destination component uses TiktokAds API. - [ETL: Trustpilot Destination](https://www.integrate.io/docs/etl/using-components-trustpilot-destination.md): Send one service-review email invitation per input record through Trustpilot's Invitations API from an Integrate.io ETL pipeline. - [ETL: Google Sheets Destination](https://www.integrate.io/docs/etl/using-components-google-sheets-destination.md): Configure the Google Sheets destination component in Integrate.io ETL to write pipeline output to a spreadsheet with OAuth, target range, and append modes. - [ETL: Connecting to Azure SQL](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-azure-sql-databases.md): Connect Azure SQL Database to Integrate.io ETL for reading and writing data. Configure firewall rules, credentials, and connection settings. - [ETL: Connecting to Azure Synapse Analytics](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-azure-synapse-analytics.md): Connect Azure Synapse Analytics to Integrate.io ETL for reading and writing analytical data. Configure access and connection settings. - [ETL: Windows File Share Destination](https://www.integrate.io/docs/etl/connecting-to-windows-file-share-destination.md): Write output files to a Windows file share (SMB/CIFS) from Integrate.io ETL using SFTP over a reverse SSH tunnel, with no inbound firewall rules. ### Scheduling, Jobs & Clusters - [ETL: Scheduling, Jobs & Clusters](https://www.integrate.io/docs/etl/category/scheduling-jobs-and-clusters.md): Run, schedule, and monitor ETL jobs in Integrate.io. Create clusters, set up recurring schedules, and track job progress and errors. - [ETL: Running Jobs](https://www.integrate.io/docs/etl/running-jobs.md): Run a validated package as a job on an Integrate.io ETL cluster. Select the appropriate cluster size, set variables, and monitor job execution. - [ETL: Scheduling Package Execution](https://www.integrate.io/docs/etl/scheduling-package-execution.md): Schedule Integrate.io ETL package execution with one-time runs, recurring intervals, cron expressions, and time-zone settings to automate pipelines. - [ETL: Monitoring Jobs](https://www.integrate.io/docs/etl/monitoring-jobs.md): Monitor Integrate.io ETL jobs: track running, completed, and failed runs, view logs and metrics, and investigate errors to keep pipelines healthy. - [ETL: Viewing All Jobs in the Account](https://www.integrate.io/docs/etl/viewing-all-jobs-in-the-account.md): View and filter all jobs running or completed across every cluster in your Integrate.io ETL account. Monitor pipeline job status from one page. - [ETL: Viewing Completed Task Outputs](https://www.integrate.io/docs/etl/viewing-completed-tasks-outputs.md): View output data from completed tasks in an Integrate.io ETL job. Inspect records processed by each component after job execution finishes. - [ETL: Viewing Job Error Details](https://www.integrate.io/docs/etl/viewing-job-error-details-for-failed-jobs.md): View detailed error messages and stack traces for failed Integrate.io ETL jobs. Diagnose pipeline failures using job error details and logs. - [ETL: Creating a Cluster](https://www.integrate.io/docs/etl/creating-a-cluster.md): Create and configure a compute cluster in Integrate.io ETL. Choose instance size, node count, and region for running your data pipeline jobs. - [ETL: Editing and Scaling Clusters](https://www.integrate.io/docs/etl/editing-and-scaling-clusters.md): Edit and scale Integrate.io ETL clusters by adjusting instance types, node counts, and configurations to match changing workload requirements. - [ETL: Monitoring Clusters](https://www.integrate.io/docs/etl/monitoring-clusters.md): Monitor the status and health of Integrate.io ETL clusters using the dashboard, API polling, or webhook notifications for real-time updates. - [ETL: Terminating a Cluster](https://www.integrate.io/docs/etl/terminating-a-cluster.md): Terminate an Integrate.io ETL cluster to stop all running jobs and release compute resources. Understand the effects of cluster termination. ### Alerts & Monitoring - [ETL: Alerts & Monitoring](https://www.integrate.io/docs/etl/category/alerts-and-monitoring.md): Set up alerts and notifications for Integrate.io ETL pipelines. Configure email, Slack, PagerDuty, and webhook hooks for job events. - [ETL: Email Hooks](https://www.integrate.io/docs/etl/email-hooks.md): Set up email hooks to receive real-time notifications about Integrate.io ETL job and cluster events directly in your inbox. Configure alerts. - [ETL: Slack Hooks](https://www.integrate.io/docs/etl/slack-hooks.md): Set up Slack hooks for real-time Integrate.io ETL notifications. Receive job status, cluster events, and pipeline error alerts in your channels. - [ETL: PagerDuty Hooks](https://www.integrate.io/docs/etl/pagerduty-hooks.md): Send Integrate.io ETL pipeline alerts to PagerDuty by configuring service hooks for job failures, slow runs, and other events to trigger on-call incidents. - [ETL: Service Hooks](https://www.integrate.io/docs/etl/service-hooks.md): Configure service hooks in Integrate.io ETL to send pipeline events such as job successes and failures to Slack, PagerDuty, webhooks, and other tools. - [ETL: Web and Email Notifications](https://www.integrate.io/docs/etl/viewing-and-setting-web-and-email-notifications.md): Configure web and email notifications for cluster and job events in Integrate.io ETL. Choose which pipeline events trigger alerts to your inbox. ### Log Drains - [ETL: Log Drains Overview](https://www.integrate.io/docs/etl/category/log-drains.md): Send Integrate.io ETL job execution logs to your own observability platform over OpenTelemetry, so failures surface in the tool your team already watches. - [ETL: Log Drains](https://www.integrate.io/docs/etl/log-drains.md): Stream Integrate.io ETL job execution logs to an OpenTelemetry (OTLP/HTTP) endpoint such as Papertrail, New Relic, Grafana, Sumo Logic, or Better Stack. ### Security & Access - [ETL: Security & Access](https://www.integrate.io/docs/etl/category/security-and-access.md): Manage security and access controls for Integrate.io ETL. Set up 2FA, SSO, SSH keys, firewall rules, IP allowlists, and user roles. - [ETL: Two-Factor Authentication](https://www.integrate.io/docs/etl/2-factor-authentication.md): Two-factor authentication requires you to submit two different secrets to complete a login, adding an extra layer of security to your Integrate.io account. - [ETL: Single Sign-On](https://www.integrate.io/docs/etl/single-sign-on.md): Configure single sign-on (SSO) for your Integrate.io ETL account using SAML 2.0. Integrate with your identity provider for team authentication. - [ETL: User Management](https://www.integrate.io/docs/etl/user-management-overview.md): Overview of user roles and permissions in Integrate.io ETL. Understand admin, member, and viewer access levels for team and account management. - [ETL: Managing Account Members](https://www.integrate.io/docs/etl/managing-your-integrateio-etl-account-members.md): You can add members to your Integrate.io ETL account to perform activities such as defining packages, creating clusters and running jobs. - [ETL: Setting Account Member Roles](https://www.integrate.io/docs/etl/setting-account-member-roles.md): Assign and manage account member roles in Integrate.io ETL. Understand admin, member, and viewer permissions for team access control. - [ETL: Custom Roles](https://www.integrate.io/docs/etl/custom-roles.md): Create custom roles in Integrate.io ETL with a tailored permission set and scope them to specific package groups or connection groups. - [ETL: Changing Your Password](https://www.integrate.io/docs/etl/changing-your-password.md): Change your Integrate.io ETL account password. Follow the steps to update your login credentials through the account security settings page. - [ETL: Password Policy](https://www.integrate.io/docs/etl/integrateio-etl-password-policy.md): Review the Integrate.io ETL password policy, including minimum length, complexity, expiration, and reset requirements for user account security. - [ETL: Managing SSH Keys](https://www.integrate.io/docs/etl/managing-your-ssh-keys.md): Manage SSH keys for secure database tunnel connections in Integrate.io ETL. Generate, upload, and configure SSH key-based server authentication. - [ETL: Reverse SSH Tunnel from Windows](https://www.integrate.io/docs/etl/set-up-a-reverse-ssh-tunnel-from-windows.md): Set up a reverse SSH tunnel from Windows to securely connect Integrate.io ETL to databases behind firewalls using PuTTY or OpenSSH clients. - [ETL: Reverse SSH Tunnel from Windows (PowerShell)](https://www.integrate.io/docs/etl/set-up-a-reverse-ssh-tunnel-from-windows-powershell.md): Set up a persistent reverse SSH tunnel from Windows to Integrate.io ETL using PowerShell, OpenSSH, and a Scheduled Task that starts on boot. - [ETL: Connecting Through a Firewall](https://www.integrate.io/docs/etl/allowing-integrateio-etl-access-to-my-server-behind-a-firewall.md): Configure firewall rules to allow Integrate.io ETL access to your database server. Whitelist IP addresses or set up SSH tunnel access. - [ETL: IP Allowlist](https://www.integrate.io/docs/etl/integrateio-etls-ip-list.md): Current Integrate.io ETL outbound IP addresses by region. Allowlist these IPs in your firewall or security group so ETL pipelines can reach your data. ### Account Management - [ETL: Account Management](https://www.integrate.io/docs/etl/category/account-management.md): Manage your Integrate.io ETL account settings, billing, plans, and team members. Migrate between development and production environments. - [ETL: Managing Account Settings](https://www.integrate.io/docs/etl/managing-your-account-settings.md): View and manage your Integrate.io ETL account settings including organization name, time zone, default region, and notification preferences. - [ETL: Modifying Personal Settings](https://www.integrate.io/docs/etl/modifying-your-personal-settings.md): Update your personal profile settings in Integrate.io ETL, including your display name, email address, time zone, and notification preferences. - [ETL: Selecting an Account](https://www.integrate.io/docs/etl/selecting-the-account-to-work-in.md): Switch between multiple Integrate.io ETL accounts using the Launchpad. Select the organization you want to work in for your current session. - [ETL: Migrating from Development to Production](https://www.integrate.io/docs/etl/migrate-from-development-to-production.md): Migrate Integrate.io ETL packages and connections from development to production. Export, import, and promote pipeline configurations across accounts. - [ETL: Selecting a Plan](https://www.integrate.io/docs/etl/selecting-a-plan.md): Compare Integrate.io ETL plans, choose the right tier for your data volume and feature needs, and learn how to upgrade, downgrade, or change billing. - [ETL: Billing and Account Usage](https://www.integrate.io/docs/etl/viewing-and-modifying-your-billing-information-and-account-usage.md): View and update your Integrate.io ETL billing details, credit card information, and account usage metrics from the account settings page. - [ETL: Signing Out](https://www.integrate.io/docs/etl/signing-out-from-integrateio-etl.md): Sign out of your Integrate.io ETL account session. Follow the steps to securely log out from the web console and terminate your active session. - [ETL: Support Rates](https://www.integrate.io/docs/etl/integrateio-etl-support-rates.md): View Integrate.io ETL support plan options and billing rates. Compare support tiers for customers on plans without allocated support hours.