+14I am trying to use the duckdb summarize command
https://duckdb.org/docs/archive/0.9/guides/meta/summarize
in an in memory duckdb using the sqlexecutor:
SUMMARIZE SELECT * FROM read_parquet('/Users/x/Downloads/Address.parquet');
This doesn’t return any results/attributes but ‘runs’ successfully in FME. In DBeaver it runs no issues.
Any idea is there is a trick to get this working?
Many ThanksQ!
Best answer by arnold_bijlsma
SELECT * FROM (SUMMARIZE SELECT * FROM read_csv('https://oedi-data-lake.s3.amazonaws.com/pvdaq/csv/systems.csv') );And in DuckDB’s SQL dialect you don’t explicitly need the “SELECT *” or the read_csv() function, so this could be abbreviated to:
FROM ( SUMMARIZE FROM 'https://oedi-data-lake.s3.amazonaws.com/pvdaq/csv/systems.csv' );
+26Have you exposed the Attributes on the Workspace?
“SELECT *” gives no clues to SQLExecutor as to what Workspace Attribute Names to create for generated Workspace Features. This will need to be set in the Attributes to Expose Parameter, or in a downstream AttributeExposer
If you however view the results in Data Inspector you will see on any individual Feature in the Feature Information any unexposed Attribute values.
+15
And its sister statement DESCRIBE even gives an error:
+15
SELECT * FROM (SUMMARIZE SELECT * FROM read_csv('https://oedi-data-lake.s3.amazonaws.com/pvdaq/csv/systems.csv') );And in DuckDB’s SQL dialect you don’t explicitly need the “SELECT *” or the read_csv() function, so this could be abbreviated to:
FROM ( SUMMARIZE FROM 'https://oedi-data-lake.s3.amazonaws.com/pvdaq/csv/systems.csv' );
SELECT * FROM (SUMMARIZE SELECT * FROM read_csv('https://oedi-data-lake.s3.amazonaws.com/pvdaq/csv/systems.csv') );And in DuckDB’s SQL dialect you don’t explicitly need the “SELECT *” or the read_csv() function, so this could be abbreviated to:
FROM ( SUMMARIZE FROM 'https://oedi-data-lake.s3.amazonaws.com/pvdaq/csv/systems.csv' );