Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-09-2022 09:09 AM
There are many ways to do this and python is one. If you have parquet files, you can also write sql easily against them. Something such as
select count(*)
from parquet.`path to parquet directory`You don't need to make tables out of the parquet files, but you can.
You can use regular python on databricks, but it won't be distributed so make sure to just use a single node cluster. You can use pyspark too.