Apache Beam: ToString Transform

Overview

If you want to convert every input element from a PCollection to a string, you should check out the ToString transforms. It can do everything from simply converting an object to a string by implicitly calling its toString() method to concatenate a kv pair with a custom delimiter.

When You Should Use the ToString Transform

You should use the ToString transforms when you want to perform the following transformations on your input data:

Transform each element into a string using the Object.toString() method
Transform an input element of type Iterables into a string using a delimiter
Transform an input element of type KV into a string using a delimiter

How to Use the ToString Transform

Just apply the built-in transform to a PCollection of elements, lists, or KVs. The output PCollection will always have the type of the String.

Example: Convert KV to String

    // Create key-value pairs
    PCollection<KV<String, String>> pairs =
        pipeline.apply(
            Create.of(
                KV.of("fall", "apple"),
                KV.of("spring", "strawberry"),
                KV.of("winter", "orange"),
                KV.of("summer", "peach"),
                KV.of("spring", "cherry"),
                KV.of("fall", "pear")));
    // Use ToString on key-value pairs
    PCollection<String> result = pairs.apply(ToString.kvs());

    // results in a PCollection containing
    // fall,apple
    // string,strawberry
    // ...etc

Conclusion

Check out other useful transforms from the official Apache Beam documentation.

Apache Beam: ToString Transform

Comments

Apache Beam and Google Cloud Dataflow

Apache Beam: Regex

More from this blog

Harnessing the IP Address  Data Type in Apache Druid (2025)

Geospatial Queries in Apache Druid: A Ride-Sharing Example

Automating Google Cloud with GitHub Actions using gcloud CLI

How to Run a Scheduled Bash Script with Google Cloud Platform

Google Dataflow Optimization: Streaming Engine

Overview

When You Should Use the ToString Transform

How to Use the ToString Transform

Example: Convert KV to String

Conclusion

Command Palette

Comments

Apache Beam and Google Cloud Dataflow

Apache Beam: Regex

More from this blog

Overview

When You Should Use the ToString Transform

How to Use the ToString Transform

Example: Convert KV to String

Conclusion