PDI is looking for a Senior Data Engineer (remote) ($125k-150k). Come help us build the next generation of campaign tech for the Democratic party and progressive organizations! https://boards.greenhouse.io/politicaldata/jobs/4073889004

Prediction Machine is a nascent hedge fund testing and launching quantitative strategies. We’re offering an opportunity to do the best work of your life, help build an enduring business, and be rewarded for the efforts. Data infra and ops are central to what we do, and I’m the managing partner and the obligatory math olympiad medalist/mit ai phd. If you’re into elegance of Prefect, are not afraid to work hard, love learning and want to see your work help break new ground on forecasting time series, get in touch at timc@predmachine.com and cc nat@predmachine.com 🙏

Prediction Machine▾

We're looking for a Data Engineer on the Data & Analytics team at Level Ex. We make video games for doctors to help them master their craft. Data is core to the business; we use Prefect and have a great opportunity for a data engineer to build out our data stack and an events messaging system. Please apply or reach out to me directly if you are interested. https://boards.greenhouse.io/levelex/jobs/4124629003?gh_src=04c9240b3us

Jupiter Intelligence is growing and looking for a software developer with a scientific background / interest to join our team. The scientific software development team leverages a modern tech stack (including Prefect!) to enable climate science at scale. We work closely with our colleagues in science and data science on climate analytics for resilience and risk management. Please reach out with questions or apply here!

Hey! In case there is anyone living in Spain and is interested in this position: https://gocleer.jobsoid.com/j/39689/data-scientist

Hi all — in addition to evaluating Prefect we’re also hiring for 100% remote positions for Data Scientist, Data Analyst, Data Engineer, and Machine Learning Engineer at Reify Health 🙂 https://www.reifyhealth.com/careers. We in the clinical research domain and are changing how trials are run (optimizing them and transforming how they are designed and made accessible to patients)

Inspired by seeing this channel, here’s an opening we have a couple of on my team: https://boards.greenhouse.io/addepar1/jobs/4619744002 Addepar is building a unified platform for managing the world’s wealth, and we are all-in currently on Prefect and Dask. Don’t be put off by the fact that it says New York, NY at the top; as far as I’m aware there’s no preference for locality anymore. Open-source friendly, we plan on contributing back to Prefect once we get our feet under us.

My team at Monad is hiring, and could use a few Prefect people 🙂 https://jobs.ashbyhq.com/monad We're building the first security data cloud platform, making security easier by enabling teams to move quickly from data to insight to action. Our stack includes FastAPI, Prefect, dbt, Snowflake, and postgresql. We're remote-first, and just announced our $17 million Series A: https://www.monad.security/news/2021/08/26/press-release/ Feel free to reach out with any questions, and thanks for checking us out!

I’m looking for someone to join my team at Paidy as a Data Science Engineer (Data Engineering/MLops): https://paidy.com/media_center/work_life/recruitment/job/4481636003 We are one of Japan’s fastest growing FinTech companies, offering BNPL services to some of the biggest brands including Amazon and Apple. You’ll be joining an international team that supports data scientists and analysts getting their work done. Oh and we love Prefect!

Hi everyone, I am on the data science team at Raptor Maps, a startup based out of Boston, MA. We are looking for some backend/data engineers. Please DM if interested. We use Prefect quite a bit!

Hi Folks, I am hiring for senior engineers to work on WW (formerly Weight Watchers) data engineering . We are in the process of building a whole new stack , which includes Prefect , and its all greenfield stuff. DM me if Data is your jam, glad to share more info.

Hi all, I'm working at Sensorfact, a Dutch scale-up saving energy in industry throughout Europe by measuring and analyzing energy consumption. We're looking for a Data Engineer to join our team -- Prefect is one of the systems you'd be working with. We're a small and friendly team with big ambitions, so there's no shortage of interesting problems, you'll have big impact on our company and you won't have to go it alone. More info here: https://sensorfact.eu/about-us/working-at/data-engineer/ We don't support fully-remote unfortunately so you'd have to live somewhere in 🇳🇱 If you don't fit the bill exactly but are interested in joining our company don't hesitate to get in touch; we expect plenty of new roles in the coming months.

Hi all, this isn't quite "find a job" but at least related. We're interested in talking to potential partner companies who can provide data engineering resources on a contract basis. Some of the work we do ingesting healthcare data is very spiky, i.e. ingest lots of historical data for new clients, and would be a great fit for contract resources. Experience with Prefect (and possibly Airflow) required. We could use something like 4 or 5 data engineers right now. Feel free to DM me here. Thanks! (Needless to say there are a lot of low-quality contracting companies so our bar would be high, i.e. engineers must have actual data engineering experience.)

Hi There!  Weedmaps continues to power a transparent and inclusive global cannabis economy by capitalizing on a decade of industry data as we built out our next-generation platform.  Cannabis is a huge (new!) emerging industry within the tech field, with the biggest trove of data out of any other company in the industry. Stack includes Spark ✨, Snowflake❄️ All roles are 100% Remote  Data Engineer Senior Data Engineer Staff Data Engineer Senior DevOps Engineer  Please feel free to apply via the link or reach out to me at bflynn@weedmaps.com

Hello 🙂 My team at Popcore is looking for a Senior Data Engineer as well. We have a self-hosted Prefect environment on AKS. Currently only several pipelines are running on it, but we are about to do more extensive migration from our old scheduler. Also, we did some nice integrations with DBT, translating the models and tests to Prefect tasks. There are lot more challenges of course, and you can find all info in the role description. Let me know if you have any more questions here on slack, or just drop me a message on marko@popcore.com. The role is remote or from our Berlin office, whatever you prefer 🙂

Hello ! At Heuritech, we are looking for a Senior Data Engineer. We do trend forecasting based on social media images analysis 🖼️, for fashion & luxury brands to better decide what product 👜 👟 to launch and in which quantity, in order to be more sustainable ! 🌍 We started using Prefect to orchestrate some of our data workflows, with great success ! We are looking for someone to help us move more workflows to Prefect (you don't have to be expert on Prefect in particular though), challenging our current architecture, and creating a Data Lake for internal users. Full remote is possible, but you have to be based near Paris for some occasional physical meetings or events. Feel free to PM me if you have any questions ! 👋

Hi there, I am having some small issues on my Prefect Server instance that I don’t have the time to solve. Any Prefect expert in here offering consulting services? (Prefect expert == I need someone to help me with deployment, not writing flows - Linux/Docker skills are a must)

In Knauf Insulation we are looking for a Data Scientist who would work closely with our central DataOps team. We are Python focused and we do use Prefect a lot 🚀 Feel free to apply directly (see the details attached) or reach out to me with a PM!

Hi guys, looking for a fully remote Kubernetes / Data Engineer to work together with (mostly) me on health data for a fasting clinic located in Germany. I've joined bc. it's a small company and it's basically tabula rasa, meaning we have almost total control of what we want to build and what to make out of the data. Really interesting healthcare data and they are industry leaders in the area of fasting science (100+ years experience). I'm working at buchinger-wilhelmi.com So what's the plan? • Extracting old terrible SQL databases into a nice PSQL/Elasticsearch Kubernetes Cluster using Prefect • Running the Kubernetes Cluster without losing sensitive medical data, especially with special attention to german healthcare laws (== strict) • Using that data to apply ML and Data Science to build dashboards, create statistics for the research department, an app they are going to publish I will mostly focus on the ETL & ML/DS part, meaning your main area would actually be Kubernetes/SysAdministration, but Prefect/ETL as well. Meaning this position would be perfect for a Kubernetes SysAdmin planning to dive into ETL/Prefect Your tech stack should be: • Kubernetes ++ • SysAdmin ++ • Python + • ETL + • Prefect + • Experience with healthcare data & laws Your benefits: • We are a small team that can basically build anything... Meaning if you have a good idea chances are really high that you can apply/create it • Fully remote • Flexible Working hours • Payment according to German market value Shoot me a mail at justin.guese@buchinger-wilhelmi.com if you are having questions, or let's just have a quick chat 😉

Hey guys, I'm hiring a Data Engineer to join my team at Simplebet! Details in thread.

Children's Hospital of Philadelphia (CHOP) is globally known for our innovative procedures, dedication to research, and outstanding clinical care (top 2 in the US). Come join an amazing team of Data Engineers and help improve the lives of pediatric patients at the same time! https://bit.ly/3BAjr8k

Hello everyone, I am happy to announce that we, at Hack Partners, are recruiting a Data and ML Ops engineer! Here are the details below, please do not hesitate to reach out! Data and ML Ops engineer (contract) You’ll be working on an exciting project which includes integrating real-time IoT sensor data with other data sources and implementing machine learning pipelines developed by our data science team. You will be focused on the workflow automation and you will us your Python skills to make the processes faster and more efficient. You’ll be developing algorithms for a network graph model of the UK transport infrastructure and building graph databases. You will be working as part of a team of experienced frontend and backend engineers and data scientist, developing a product which will have a big real-world impact within the transport industry. This is a contract role starting immediately and finishing in March, with a possibility of a full-time employment afterwards. Requirements: Essential • Excellent Python skills (2-3 years of experience) • Experience working with real-time data feeds • Experience working with databases • Workflow automation Desirable • Graph database knowledge • Experience with Prefect (Python-based workflow management system/library) • GCP • Go Please contact milda@hackpartners.com

Hello, everyone, I'm a social scientist with experience of working with structured and unstructured datasets using Python (dask, pandas, numpy, sklearn) with econometric analysis in Stata. I am interested in remote opportunities, ideally something that is async or is sufficiently flexible in overlap with my timezone, UTC+6, I'm based in Almaty, Kazakhstan. Some of the roles that I am interested in are: data engineer, data science, technical writing. I am ready to discuss other opportunities. My email is contact@econpoint.com, and a few links: LinkedIn, GitHub, StackOverflow. Please feel free to reach out to me by email or via LinkedIn. I don't have as much experience with prefect (so far I was using snakemake), but orion looks very exciting, so I'm eager to work more with it. I have almost no experience with cloud, as I was working on HPC before, but hope to fix this in the coming months.

We are expanding!, I’m hiring for multiple roles, Singapore calling can start Remote immediately Want to build in the exciting world of Predictive Intelligence, Supply Chains & Logistics ? Remember the Suez Canal Issue ? We were at the heart of the game sharing realtime insights with Fortune 500 Enterprise customers on risk management with real time data.  Portcast is Singapore based well funded Startup looking for passionate individuals to join our team.   These are the roles that I am currently hiring for: - Senior Backend Engineer: https://lnkd.in/gpwZMeS6  - Sales Director: https://lnkd.in/gGd6Xdv5  - Product Manager: https://lnkd.in/gzpDQuXM  - Recruiter: https://lnkd.in/gcFzKthf - Data Analyst: https://angel.co/l/2vRXNp - Senior Data Scientist: https://angel.co/l/2vUgB5 Why Portcast: - Chance to work with cutting edge technology: We don't use the words AI/ML casually, our proprietary machine learning algorithms are at the core of what we do. The data sets that you would work with are timeseries, geospatial and textual in nature e.g. vessel location, satellite data, weather patterns, etc.  - A diverse team with a fast-paced but friendly and respectful culture: Our team members hail from India, Singapore, Ukraine, China and Portugal. - Remote work friendly: We have adapted to the remote working culture. We focus on accountability in terms of outcomes rather than actions. - Rewarding work: You will be given very high levels of ownership and will be able to see the impact of your work on the customers as well as the company financials in a very direct way.  - Growth: Given the pace at which the firm is growing, we can promise you a steep learning curve, as your work evolves with the pace. In News: https://techcrunch.com/2021/09/06/portcast-gets-3-2m-to-create-more-transparent-and-sustainable-supply-chains/ Email me directly for a 15min chat: sagun.garg@portcast.io We use Prefect to move mountains in our data pipelines 😈 [real badass]

Hello everyone! We have a new opening at Fabulous for a (Senior) Analytics Engineer - Full Time - Fully Remote: https://apply.workable.com/fabulousco/j/4AE7D1737E/ This is a new important role at the Data Science Team to further scale up our data pipelines and data science products. In this role, you will collaborating closely with the Head of Data with exposure on both the engineering/analytics and the business sides of Fabulous. For the right candidate, this role can potentially lead to becoming our technical lead! Current stack: dbt, Fivetran, Bigquery, Amplitude, Metabase, Data Studio Born at Duke University, Fabulous uses behavioral science to help people make smart changes and build healthy habits. The Data Science Team’s mission is to marry data-driven practices and products to business and behavioral science.

Hello everyone! Exos Financial is hiring a Quantitive Data Engineer to join our Quantitative Strategies group. Please DM me for more information or apply here. This is an NYC based position with a flexible WFH policy. What is a Quantitative Data Engineer? A Quantitative Data Engineer is able to build durable pipelines for ingesting and transforming datasets from a variety of sources, in diverse formats, at multiple scales. Quantitative Data Engineers utilize distributed computing and cluster technology to accelerate research and deliver results faster. They are excited by the idea of leveraging emerging technologies to push the boundaries of quantitative finance.  Summary: We are an industry-leading, modern B2B financial services fintech looking for a Quantitative Data Engineer to assist in building out our quantitative research platform. The ideal candidate will have strong Python programming abilities, experience dealing with large and heterogeneous datasets, and the skills necessary to deliver high-quality software solutions in a fast-paced environment. This role will work closely with quantitative researchers to design and support advanced research capabilities, as well as our data engineering teams to share knowledge and best practices across the firm.  Responsibilities: • Design and develop a cloud native high performance quantitative research platform. • Design systems for distributed model fitting and signal generation on the research platform. • Design and build tools for distributed backtesting of algorithmic trading strategies. • Build out pipelines and tools for ingesting new datasets onto the research platform. • Develop sophisticated data quality metrics and reporting to ensure mission critical datasets are consistent and reliable. • Design and implement metadata tools such as data catalogs, feature stores, and signal catalogs. • Create, monitor, and maintain production data pipelines required for daily trading activity. Qualifications: • Strong problem solving skills with the ability to both turn around ideas quickly and work on longer term ambiguous projects. • 2+ years of professional Python programming experience. • Experience with the Python scientific computing stack (numpy, pandas, etc.). • Excellent written and verbal communication skills for coordinating across teams. • Experience with the following is a plus: ◦ AWS ◦ Dask ◦ Prefect

Hey folks! Titan Advanced Energy Solutions is hiring a Data Engineer to join our Algorithms team. At Titan, we're leveraging ultrasound technology to provide advanced battery diagnostics that improve battery efficiency, safety, and longevity. Our team works with large volumes of ultrasound and associated metadata data, and the Algorithms team is building a cloud native platform leveraging AWS, Snowflake, Prefect, and Dask to better store, manage, process, and model with this data at scale. The position is based in Salem, MA, just north of Boston. The responsibilities of the role include: • Implementation, deployment, and maintenance of replication, ETL, and data validation pipelines that operate on TBs of ultrasound sensor data • Writing Python libraries that provide easier access to data and construction of pipelines to process data at scale • Evaluation, deployment, and scaling of cloud native data management infrastructure including data storage and processing systems • Writing and maintaining documentation on data storage and processing systems • Collaboration with the broader Algorithms group to advise on use cases and create repeatable patterns for data processing pipelines that the team can implement to support modeling and analysis use cases Qualifications include: • 2+ years’ working experience engineering data intensive applications • Expertise with Python in a production environment • Experience with AWS services, especially S3, Lambda, and Batch • Experience working with large amounts of data in a variety of formats • Experience building automated validation and processing pipelines • Experience supporting ML pipelines and applications • Expertise with SQL, database design • Ideal candidates would have experience with ◦ Docker ◦ Prefect or Airflow ◦ Dask See our job posting here for more details, and please DM or apply if you're interested!

Hello everyone... I'm trying to start using prefect for what i think is a pretty common scenario. i have developed a group of jupyter notebooks to perform some ETLS. Basically I download files from sharepoint to local folders make some tranformations and save new files on local filesystem. I can call jupyter notebooks with a specific prefect task or do i have to turn each function inside the notebook into a specific prefect task ?

Hi everyone! We are hiring a Data Engineer to join our Data & Analytics team at EIGENSONNE in Berlin, Germany. Our mission at EIGENSONNE is to enable everyone to produce their own green energy by digitalising renting, selling and usage of PV systems, electricity storage and charging stations. Our goal is to equip every roof in ​Europe with an EIGENSONNE system. Backing us is a large German energy supplier who guarantees our long-term financial and strategic stability. YOUR BENEFITS • We make sure you have a perfect start to your new job. From the first day on, we will provide you with a detailed onboarding plan, and also a buddy to take care of you. • We offer a competitive target salary, matched on your experience. • We maintain an open-minded and transparent philosophy. Regular feedback is not only giving you the chance to express yourself, but also to receive input from your colleagues. • Take the chance to grow with EIGENSONNE. We support your further development with a personal development budget and frequent coaching. •  Our teams are characterised by supporting and trusting each other. We stand together with our goals. Regular events help us to grow together even more as a team. • With us you get permanent employment, flexible working hours, and remote working support for your work-life balance. Since your well-being is important to us, you are entitled to 30 days of vacation each year. YOUR RESPONSIBILITIES • You will enable a team of data analysts and data scientists to work more efficiently by building and managing EIGENSONNEs data infrastructure • You will enhance our existing data pipeline by implementing new data sources and transformation processes and make sure the processes run efficiently and are continuously monitored and improved for performance and data quality • You will help the data scientists to bring their ML models into production and automate the model training and model serving to different applications • You will manage and enhance the cloud data infrastructure and improve CI/CD workflows • You will coach junior engineers and share your knowledge with them YOUR PROFILE • You have a proven track record of developing scalable data infrastucture in Python • You have a strong grasp of database structures, design and query languages, such as SQL • You have experience in working with stream-based data processing (Kinesis or Kafka) • You have a good understanding of cloud infrastructure platforms such as AWS or Google Cloud • You are familiar with setting up and working with CD/CI workflows • Strong working English skills Desirable: • Experience with workflow orchestration tools (e.g. Airflow or Prefect) • Knowledge of different IaC solutions (e.g. Terraform) • Container technologies