TabLab

Merge Parquet files online

Merge multiple Parquet files into a single file. Combine data from different sources quickly and easily.

Format

Files

Click anywhere to select filesor drag and drop files here
Accepts Parquet files (.parquet)

Trusted by over 40,000 every month

Parquet Merge Features

Multiple File Merging
Combine any number of files into a single consolidated file
Lightning-Fast Performance
Merge even large files instantly with optimized processing
Streamlined File Merging
Efficiently combine multiple files into a unified dataset
SQL-Powered Merging
Use SQL queries for advanced merging with custom join conditions
AI-Powered Assistance
Describe your merging needs in plain English for complex scenarios
Export Merged Data
Save your combined results in various formats

How to merge Parquet files

  1. Upload two or more Parquet files using the upload button
  2. Files will be appended in the order they were uploaded
  3. Preview the merged result
  4. Download the combined Parquet file

How to merge Parquet files in python

Here are three effective ways to merge multiple Parquet files in Python using different libraries. Each approach has its own advantages depending on your specific needs and file sizes.

Merging Parquet files with pandas

Pandas provides a straightforward approach for merging files and works well for most common data tasks:

First, let's install pandas if you haven't already:

bash
pip install pandas

Now we can load your Parquet files into dataframes:

python
import pandas as pd

Let's load your first file:

python
df1 = pd.read_parquet('path/to/file1.parquet')

And your second file:

python
df2 = pd.read_parquet('path/to/file2.parquet')

Great! Now we can merge the dataframes using the concat function:

python
merged_df = pd.concat([df1, df2], ignore_index=True)

Finally, let's save your newly merged data to a file:

python
merged_df.to_parquet('path/to/merged_file.parquet', index=False)
by @scottpaulin