Channels
pacc-may-31-2023
prefect-ai
pacc-clearcover-june-12-2023
marvin-in-the-wild
data-ecosystem
geo-israel
pacc-june-14-2023
geo-japan
prefect-cloud
ppcc-may-16-2023
prefect-azure
prefect-docker
prefect-recipes
gratitude
geo-nyc
geo-bay-area
geo-boston
geo-london
geo-dc
geo-chicago
geo-berlin
geo-texas
geo-seattle
geo-colorado
prefect-community
data-tricks-and-tips
prefect-aws
prefect-gcp
introductions
find-a-prefect-job
prefect-dbt
random
events
ask-marvin
show-us-what-you-got
prefect-getting-started
prefect-integrations
prefect-contributors
best-practices-coordination-plane
announcements
prefect-server
prefect-ui
prefect-kubernetes
Powered by
Title
p
Prasanth Kothuri
02/28/2023, 8:10 PM
duckdb anyone ? I replaced a postgres db (used for OLAP) with duckdb + parquet file
:duckdb: 1
:prefect-duck: 1
👀 1
c
Chris Reuter
02/28/2023, 8:26 PM
do you use it on a local machine, host it somewhere on a VM and give people access?
r
redsquare
02/28/2023, 8:30 PM
lack of clustering an issue with duck, fine for local jobs but not to support a high throughout analytical api behind
c
Chris Reuter
02/28/2023, 8:32 PM
That's the common issue I've heard as well - scalability/no options for user/role management
but if you don't care about that and single node is fine then 💥
r
redsquare
02/28/2023, 8:33 PM
indeed
clickhouse-local is the same
https://clickhouse.com/docs/en/operations/utilities/clickhouse-local/
c
Chris Reuter
02/28/2023, 8:42 PM
In honor you of
@redsquare
:redsquare:
🙌 1
j
Janet Carson
03/02/2023, 3:41 AM
For me, parquet/duck is a way to stage data in a query-able format to check that things are clean before moving to Postgres db.
#data-ecosystem
Join Slack