set the channel description: Life, the Universe and Everything

set the channel topic: Life, the Universe and Everything

gifs allowed here

@Marvin you here?

Happy Friday y'all!! 🥳

Hi everyone I have slack related question, a message will be disappeared because of the slack limit, but if I save the message will it be disappeared too? Or there are any tips to save messages/thread?

I just wanted to say a quick thanks to all the Prefect folks who monitor #prefect-community. The responsiveness to assisting people with a huge range of difficult edge case issues is amazing. Other companies trying to drive developer adoption of their platform should be using you all as a model. 🙏

Sharing some cool data visualization I saw

My PyCon swag arrived!

Anyone here attenting the Dask summit? What talks did you find interesting?

shout out to @Kevin Kho for providing awesome support in getting us setup on coiled + prefect. Definitely going to dive in deep on this and I feel very confident going forward in our org given that such awesome people are willing to chime in and help.

interesting article about emerging architectures for modern infrastructure, you can see that workflow managers like Prefect is so important to make an unified data architecture

Shoutout to @Kevin Kho who followed me to the coiled slack and helped me there.

I want to shout out @Kevin Kho who has been a fantastic help resolving issues that we've faced, support like this solidifies my reasons to move to prefect. #awesome

this times 10 ^

It’s true @Kevin Kho does awesome work for the community, and I’ll attest that he works just as hard behind the scenes to keep everything running!

Good album for working with prefect: https://open.spotify.com/album/5eOlKFDAN9dXwYycRqEmnP?si=YWLZHUTvS0-vVM3u4dKeMg&dl_branch=1

mostly just the name

website refresh is 💯

Whee, got my first Prefect flow to run correctly on Dask on Kubernetes

Hey guys, I have a question - I was reading https://www.prefect.io/blog/prefect-0-15-0-a-new-flow-run-experience/ and at the end there is section about reaching to you and only clickable link is to "join our Slack community". I wanted to find out more about your meetups events, whether they are online/or recorded but the link is not clickable. Can you tell me whether this is a bug or a feature? 😛 🙂

AttributeError: 'Manager' object has no attribute 'prefect_related'

- this has happened to me multiple times

#DjangoJokes

Looking for any resources regarding development lifecycles between local, dev, and prod environments for data engineering projects - specifically using Dask/Prefect, but that’s probably too niche so other resources are welcome!

Why data scientists shouldn’t need to know Kubernetes This post is to argue that while it’s good for data scientists to own the entire stack, they can do so without having to know K8s if they leverage a good infrastructure abstraction tool that allows them to focus on actual data science instead of getting YAML files to work.

Hi Guys! I'm just starting in this world of data engineering. I've learned and started with Airflow, but now i want to give a try to Prefect, the thing is, i've managed to get my server running in a Docker Enviroment, everything is working ok, i have the UI, Agents, Etc. But i dont know how to start making my .Py files, in Airflow i had a folder called DAGS where via SSH i could copy my files and import them. How i'll do that in Prefect? Thanks, Sorry for my English.

We are experiencing extremely slow task submission via the

DaskExecutor

for very large mapped tasks. With previous flow tests where a task was mapped over roughly 20K items, task submission was sufficiently fast that our Dask cluster scaled workers up to the worker limit. But with a task mapped over 400K items, the

DaskExecutor

task submission to the scheduler appears rate limited and there are never sufficient tasks on the scheduler it to create more workers and scale so we are stuck with the cluster crawling along with the minimum number of workers.

It's official! And

StratifiedGroupKFold

is finally here... https://scikit-learn.org/stable/whats_new/v1.0.html#changes-1-0