Sam Cox

    Sam Cox

    1 year ago
    Hi, right now I am storing individual flows in gitlab, and occasionally I get the error:
    Failed to load and execute Flow's environment
    followed by a GitLab MaxRetryError, probably because we are reading from gitlab too many times in a given time period. Using gitlab as storage is important for some of our current projects, but is there a way to retry a flow when the Flow's environment fails to load?
    Kevin Kho

    Kevin Kho

    1 year ago
    Hi @Sam Cox! I don’t think there is a way to automatically retry like this because that would potentially lead to just infinite retrying. Do these Flows work normally and you’re sure it’s Gitlab? Would you know the API limit of Gitlab by any chance?
    Sam Cox

    Sam Cox

    1 year ago
    Hi Kevin! Yeah I figured there might be issues in those situations. And yes the flows will work about 90-95% of the time, with occasional failures, spread out randomly and at different times. We do store quite a few flows from gitlab. I'll check on the API limit, but this is a more detailed look at the specific error:
    Failed to load and execute Flow's environment: ConnectionError(MaxRetryError("HTTPSConnectionPool(host='', port=): Max retries exceeded with url: "" (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x5>: Failed to establish a new connection: [Errno -2] Name or service not known'))"))
    Obviously it isn't your job to figure out our gitlab situation, but if you have ideas on retrying a read from the storage location, that would be great!
    Kevin Kho

    Kevin Kho

    1 year ago
    How did you point this error to be Gitlab? Was the url populated but you just took it out for privacy? Is that a self-hosted Gitlab? I don’t have any suggestions at the moment unfortunately. On that last question, I’m not exactly sure what you’re referring to. I think there were discussions of loading in module dependencies, but for Docker you can just put your repo. Striking this out cuz I saw you deleted.
    Sam Cox

    Sam Cox

    1 year ago
    Yes the url was populated but I removed it for privacy, it's definitely on the gitlab side. And thanks for answering my retry question!