Table of Contents

We’re excited to share our latest set of features and enhancements that boost productivity, expand connectivity, and streamline low-code data integration workflows across the platform.

This release introduces an AI Transformation Component, a native SharePoint source connector, a Pivot Transformation Component, and scheduler auto-retries, alongside broad reliability and schema improvements. Between AI-powered transforms, SharePoint ingestion, flexible pivoting, and self-healing schedules, we’re doubling down on delivering the most modern open data movement and observability solution for data engineering teams. Here are the new feature updates to help you confidently build your pipelines.

AI Transformation Component (New)

thumbnail image

Bring advanced enrichment and processing directly into your ETL pipelines. The AI Transformation Component applies cleansing, normalization, classification, summarization, and text enrichment where your data already flows, reducing external round-trips and speeding time-to-value. It respects your existing pipeline settings and field mappings, outputs structured results you can join or aggregate downstream, and supports guardrails such as max-token limits and fallback behavior to keep runs predictable and cost-aware.

SharePoint Connector (New Source)

thumbnail image

Ingest files and lists from SharePoint with a native source component purpose-built for collaboration data. The connector streamlines extraction from libraries and list endpoints, handling authentication, pagination, and metadata so operational content and shared workbooks land cleanly in your warehouse. Use selective field and file-type filters to control payload size, run incremental syncs based on modified timestamps, and standardize SharePoint data for analytics, governance, and cross-team reporting.

Pivot Transformation Component (New)

thumbnail image

Reshape rows into columns to produce analysis-ready layouts without brittle spreadsheet workarounds. The Pivot Transformation Component lets you define key, index, and value fields to generate wide tables for BI, modeling, or export. It supports aggregation during pivot (sum, count, min, max, avg), consistent handling of nulls and duplicates, and deterministic column naming, so dimensional outputs remain stable across runs and easier to version in downstream models.

Scheduler Auto-Retry on Failure (New)

thumbnail image

Improve reliability with automatic retries for failed packages right in the ETL scheduler. Transient errors, like brief API throttling or network hiccups, are retried according to configurable backoff rules, reducing manual restarts and on-call toil. Each attempt is logged with context, so you retain full visibility into failure reason, retry count, and final outcome while keeping real-time Salesforce SFTP workflows on track.

Additional Product Updates

  • Pagination Support: Added for Help Scout, Bamboo HR, FreshService, HeyMarket, and Teamwork APIs to improve large-dataset handling.

  • Jobs List UI: Display of workspace name and updated styling for faster identification and triage.

  • Bing Ads Schema Importer: Improved schema loading for quicker integration readiness.

  • Salesforce Connector (ELT): Expanded API version support to v64 for broader compatibility.

  • NetSuite SOAP Destination: ID-based access for custom object retrieval to simplify mappings.

  • Schema Importer: Better variable evaluation and improved BigQuery datetime type detection.

  • MySQL & PostgreSQL (ELT): Chunking mechanisms to support very large datasets and long string values.

  • Klaviyo Connector: Improved schema handling for more consistent loads.

  • NetSuite SOAP Source: Fixed incremental-load field listing for accurate sync control.

  • Salesforce Destination (ETL): Required fields now render correctly in schema mapping and new components.

  • Schema Preview Fixes: More robust date-variable evaluation and clearer errors for unsupported expressions.

  • HubSpot Destination: Detailed JSON returned for failed record exports to speed troubleshooting.

  • NetSuite Destination: Resolved autonumbering behavior for smoother insert operations.

  • Facebook Ads Connector (ETL & ELT): Upgraded to v23.0 and clarified source/destination labels in the UI.

  • Azure File Storage Component: Stricter variable validation in bucket values to prevent connection errors.

What’s Next on the Roadmap for Integrate.io

  • JSON Autoparse: Automatically flatten nested JSON for faster low-code transformations.

  • Timezone on Schedules: Create and view schedules in your local timezone for real-time orchestration.

  • Intelligent File Ingestion & Mapping: AI-powered file workflows that detect structure and auto-map columns.

  • Snowflake CDC Source Connector: Ingest table changes without relying on timestamp columns.

  • New Native Connectors: HubSpot, Google Sheets, and more.

All updates are rolled out. Connector availability may vary by plan. You can read more detailed information on all features that make Integrate.io a leader in data pipeline automation, which is available on Integrate.io’s Documentation Page.