Forum Discussion

MangoMagic's avatar
MangoMagic
Copper Contributor
May 02, 2025

Dataflow snowflake connection issue

I'm trying to set up a sink to snowflake in dataflow, but when I test the connection it doesn't work

 

It just comes out JDBC driver communication error, tried searching online and looking at documentation link but couldn't find anything about this issue.

 

But this same dataset works fine outside of the dataflow, I can preview the data in same dataset:

There seems to be issue with dataflow. Even when I try to execute the dataflow through pipeline the same error message comes up:

Does anyone know how to solve this problem with dataflows?

Also with the sink settings option if I select recreate table will it create the table in snowflake if it doesn't already exist?

Trying to find an easy way to copy a lot of tables into snowflake without explicitly having to create the table first especially if the metadata is only known at runtime, the pipeline copy job doesn't work as the table has to exist before it can insert data into it, but dataflow seems promising if the connection actually works.

2 Replies

  • ItsBhatti's avatar
    ItsBhatti
    Iron Contributor

    A "Dataflow Snowflake connection issue" usually means that Google Dataflow can't connect to your Snowflake database. Common causes include:

    Incorrect credentials or connection string

    Network/VPC/firewall restrictions

    Snowflake IP allowlist not including Dataflow IPs

    Missing required JDBC driver or library in the pipeline.

    Would you like help troubleshooting a specific error message?

    • MangoMagic's avatar
      MangoMagic
      Copper Contributor

      Don't understand why the same connection doesn't work inside a data flow when it clearly works in ADF in a normal pipeline or dataset (that is not part of a dataflow)?

       

      The error message I get is same as the screenshots I attached previously, it doesn't give me any more than this

Resources