https://prefect.io logo
Join Slack
Powered by
<@ULVA73B9P> I'm trying to put a csv file into a S...
# ask-marvin
k
@Marvin I'm trying to put a csv file into a Snowflake internal stage, but I'm getting the error shown below. I'm able to create the internal stage with the prefect-snowflake connector just fine.
Copy code
snowflake.connector.errors.RequestExceedMaxRetryError: GET with url b'<https://sfc-eu-ds1-20-customer-stage.s3.amazonaws.com/?accelerate>' failed for exceeding maximum retries.
m
Your message was too long by 2052 tokens - please shorten it and try again. For reference, here's your message at the allowed limit:
I'm trying to put a csv file into a Snowflake internal stage, but I'm getting the error shown below. I'm able to create the internal stage with the prefect-snowflake connector just fine.
```Traceback (most recent call last): File "C:\Users\prefectservice\Documents\GitHub\Data-Warehouse\src\main.py", line 20, in <module> test_flow( File "C:\Users\prefectservice\Documents\GitHub\Data-Warehouse\venv\prefect\lib\site-packages\prefect\flows.py", line 1229, in call return enter_flow_run_engine_from_flow_call( File "C:\Users\prefectservice\Documents\GitHub\Data-Warehouse\venv\prefect\lib\site-packages\prefect\engine.py", line 293, in enter_flow_run_engine_from_flow_call retval = from_sync.wait_for_call_in_loop_thread( File "C:\Users\prefectservice\Documents\GitHub\Data-Warehouse\venv\prefect\lib\site-packages\prefect\_internal\concurrency\api.py", line 218, in wait_for_call_in_loop_thread return call.result() File "C:\Users\prefectservice\Documents\GitHub\Data-Warehouse\venv\prefect\lib\site-packages\prefect\_
It seems like the issue you're encountering isn't well-documented in Prefect's documentation nor a common topic in GitHub issues. However, based on general guidance and similar errors, here are a few steps you can take to troubleshoot and possibly resolve your issue: 1. Configure Retries: Set the retry configurations for your Snowflake connector to be more lenient.
Copy code
python
   from prefect_snowflake import SnowflakeCredentials

   # Load your Snowflake credentials
   snowflake_credentials_block = SnowflakeCredentials.load("BLOCK_NAME")

   # Get client with retry settings
   connection = snowflake_credentials_block.get_client(
       retries=10,  # Configure the number of retries
       retry_sleep=5  # Configure the sleep duration between retries (in seconds)
   )
2. Check Snowflake and AWS Connectivity: Ensure you have stable network connectivity to both Snowflake and AWS S3. Remember, Snowflake internal stages often use S3. 3. Audit Privileges: Make sure the Snowflake user has the correct permissions to access the internal stage and S3. 4. Snowflake Configuration: Validate and, if needed, update your Snowflake configuration, as well as retrying the connection logic if the failure might be due to transient network issues. Refer to the Prefect Snowflake Connector Documentation for additional insights. If these steps do not solve the issue, consider collecting more detailed logging information and contacting Snowflake support. #### Resources - Prefect Snowflake Connector - Prefect-Snowflake Database Documentation - Prefect-Snowflake Credentials It’s tiresome, I know. But such is life with endless bugs, isn’t it?
3 Views
Open in Slack
PreviousNext
Powered by