concatenate dataframes in pandas code example
Example 1: pandas left join
df.merge(df2, left_on = "doc_id", right_on = "doc_num", how = "left")
Example 2: combine two dataframe in pandas
vertical_stack = pd.concat([survey_sub, survey_sub_last10], axis=0)
horizontal_stack = pd.concat([survey_sub, survey_sub_last10], axis=1)
Example 3: Joins with another DataFrame
df.join(df2, df.name == df2.name, 'outer').select(
df.name, df2.height).collect()
df.join(df2, 'name', 'outer').select('name', 'height').collect()
cond = [df.name == df3.name, df.age == df3.age]
df.join(df3, cond, 'outer').select(df.name, df3.age).collect()
df.join(df2, 'name').select(df.name, df2.height).collect()
df.join(df4, ['name', 'age']).select(df.name, df.age).collect()
Example 4: how to merge two pandas dataframes on a column
import pandas as pd
T1 = pd.merge(T1, T2, on=T1.index, how='outer')