Hi All. I am one of the thousands of newly unemployed data analysts/engineers, and I am looking to continue my upskilling to include Prefect, while also finding an online public dataset that is continuously updated that I can do batch, or micro-batch extracts from to populate an iceberg-based data lakehouse, while also applying dbt to the workflow to build various analytics views in PowerBI, Tableau, and Apache Superset. This is all to create a demonstratable portfolio in github or gitlab CI/CD. Before I spend hours looking for that right candidate dataset, could any of you already suggest a public dataset, with a URL? Thanks in advance.

Weather! Look at openmeteo.

Thanks Janet. I am looking at weather as we speak. Let me find openmeteo. Thanks again!

hi @Phillip Shearin a bit of a odd/fun recommendation, but atproto applications are a great source of data that you can do data lake -> dbt refinement etc on i wrote an example a while ago using assets + duckdb + dbt to build an analytics dashboard from bluesky (twitter on atproto) so its not a "dataset" per se, but an everlasting firehose of data you can selectively capture/refine as desired

Very cool Nate. Thank you!