> ## Documentation Index
> Fetch the complete documentation index at: https://www.integrate.io/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# ETL: Filter Transformation

> Use the Filter transformation to include or exclude records based on conditional expressions. Define rules to control data flow in pipelines.

<Frame>
  <img src="https://mintcdn.com/integrateio/OwEKdS5aIKsEcmhX/images/creating-packages/using-components-filter-transformation/image-1.png?fit=max&auto=format&n=OwEKdS5aIKsEcmhX&q=85&s=3fc3864fc36dc2cd4b258644f308ede4" alt="Filter component configuration panel" width="1200" height="828" data-path="images/creating-packages/using-components-filter-transformation/image-1.png" />
</Frame>

## Conditions

### Logical operator

By default, a record must match all the conditions.

<Frame>
  <img src="https://mintcdn.com/integrateio/OwEKdS5aIKsEcmhX/images/creating-packages/using-components-filter-transformation/image-2.png?fit=max&auto=format&n=OwEKdS5aIKsEcmhX&q=85&s=263ba60e42f04b39e0b239784935a972" alt="Logical operator selection for filter conditions" width="536" height="254" data-path="images/creating-packages/using-components-filter-transformation/image-2.png" />
</Frame>

* **Match all of the following conditions (AND)** - selects records with values that meet all conditions specified (logical "AND")

  <Frame>
    <img src="https://mintcdn.com/integrateio/OwEKdS5aIKsEcmhX/images/creating-packages/using-components-filter-transformation/image-3.png?fit=max&auto=format&n=OwEKdS5aIKsEcmhX&q=85&s=3a42cb2bb19bf8f5f166e27425997d5d" alt="Match all conditions AND operator example" width="1200" height="828" data-path="images/creating-packages/using-components-filter-transformation/image-3.png" />
  </Frame>

* **Match any of the following conditions (OR)** - selects records with values that meet at least one of the conditions specified (logical "OR")

  <Frame>
    <img src="https://mintcdn.com/integrateio/OwEKdS5aIKsEcmhX/images/creating-packages/using-components-filter-transformation/image-4.png?fit=max&auto=format&n=OwEKdS5aIKsEcmhX&q=85&s=b465c7ea7853700aad66b631430af526" alt="Match any condition OR operator example" width="1200" height="828" data-path="images/creating-packages/using-components-filter-transformation/image-4.png" />
  </Frame>

* **Match none of the following conditions (NOT)** - selects records with values that doesn't meet any of the conditions specified (NOT ( ... OR ... ))

### Specifying conditions

Each condition comprises of an expression (or field), a comparison operator , and possibly another value or expression to compare with (depending on the operator).

* **Expression (left-hand)** - In the drop-down list on the left, select a field or edit an expression. (You can read more about [expressions](/etl/using-expressions-in-integrateio-etl/) and [functions](/etl/integrateio-etl-functions/))
* **Operator** - Select the operator from the following list:
  | Operator          | Description                                                                                                                                                                                                                                                                 |
  | :---------------- | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
  | text equals       | The expression on the left must be equal to the string value on the right. The text should not be enclosed in quotes or escaped.                                                                                                                                            |
  | text not equals   | The expression on the left must not be equal to the string value on the right. The text should not be enclosed in quotes or escaped.                                                                                                                                        |
  | text matches      | The expression on the left must match the regular expression string value on the right. The text should not be enclosed in quotes or escaped. For example, matching a string field with .\*dog.\* would pass any string that contains the string dog: dog, dogs, adogmatic. |
  | text is empty     | The expression on the left must be empty.                                                                                                                                                                                                                                   |
  | text is not empty | The expression on the left must not be empty.                                                                                                                                                                                                                               |
  | =                 | The expression on the left must be equal to the expression on the right.                                                                                                                                                                                                    |
  | !=                | The expression on the left must not be equal to the expression on the right.                                                                                                                                                                                                |
  | >                 | The expression on the left must be greater than the expression on the right.                                                                                                                                                                                                |
  | >=                | The expression on the left must be greater than or equal to the expression on the right.                                                                                                                                                                                    |
  | `<`               | The expression on the left must be less than the expression on the right.                                                                                                                                                                                                   |
  | `<=`              | The expression on the left must be less than or equal to the expression on the right.                                                                                                                                                                                       |
  | is null           | The expression on the left must be null.                                                                                                                                                                                                                                    |
  | is not null       | The expression on the left must not be null.                                                                                                                                                                                                                                |
  | is true           | The expression on the left must true - especially useful when left hand side is a complex expression.                                                                                                                                                                       |
* **Value/Expression** - with text operators, type the text or pattern to compare to. With other operators, pick a field or edit an expression.

## Related

<CardGroup cols={2}>
  <Card title="Select Transformation" icon="arrow-right" href="/etl/using-components-select-transformation" horizontal />

  <Card title="Join Transformation" icon="arrow-right" href="/etl/using-components-join-transformation" horizontal />

  <Card title="Using Expressions" icon="arrow-right" href="/etl/using-expressions-in-integrateio-etl" horizontal />
</CardGroup>
