Channels
pacc-july-11-12-2023
pacc-sept-20-21-2023
pacc-aug-16-2023
pacc-aug-29-30-2023
pacc-may-31-2023
prefect-ai
pacc-clearcover-june-12-2023
pacc-sept-26-27-2023
pacc-july-6-2023
intros-test
livestream-chatter
marvin-in-the-wild
data-ecosystem
geo-israel
pacc-june-14-2023
geo-japan
pacc-london-2023
pacc-sept-13-14-2023
prefect-cloud
ppcc-may-16-2023
prefect-azure
prefect-docker
prefect-recipes
gratitude
geo-nyc
geo-bay-area
geo-boston
geo-london
geo-dc
geo-chicago
geo-berlin
geo-texas
geo-seattle
geo-colorado
pacc-july-17-18-2023
introductions
prefect-server
data-tricks-and-tips
prefect-aws
prefect-gcp
find-a-prefect-job
prefect-dbt
random
events
ask-marvin
show-us-what-you-got
prefect-getting-started
prefect-integrations
prefect-contributors
best-practices-coordination-plane
announcements
prefect-ui
prefect-kubernetes
pacc-aug-22-23-2023
prefect-community
Powered by
#data-ecosystem
Title
p
Prasanth Kothuri
02/28/2023, 8:10 PM
duckdb anyone ? I replaced a postgres db (used for OLAP) with duckdb + parquet file
duckdb
1
prefect duck
1
👀 1
c
Chris Reuter
02/28/2023, 8:26 PM
do you use it on a local machine, host it somewhere on a VM and give people access?
r
redsquare
02/28/2023, 8:30 PM
lack of clustering an issue with duck, fine for local jobs but not to support a high throughout analytical api behind
c
Chris Reuter
02/28/2023, 8:32 PM
That's the common issue I've heard as well - scalability/no options for user/role management
but if you don't care about that and single node is fine then 💥
r
redsquare
02/28/2023, 8:33 PM
indeed
clickhouse-local is the same
https://clickhouse.com/docs/en/operations/utilities/clickhouse-local/
c
Chris Reuter
02/28/2023, 8:42 PM
In honor you of
@redsquare
redsquare
🙌 1
j
Janet Carson
03/02/2023, 3:41 AM
For me, parquet/duck is a way to stage data in a query-able format to check that things are clean before moving to Postgres db.
Post