Import JSON into ClickHouse
The latest ClickHouse release (v1.1.54023) supports input_format_skip_unknown_fields
user option which eneables skipping of unknown fields for JSONEachRow and TSKV formats.
Try
clickhouse-client -n --query="SET input_format_skip_unknown_fields=1; INSERT INTO event FORMAT JSONEachRow;"
See more details in documentation.
Currently, it is not possible to skip unknown fields.
You may create temporary table with additional field, INSERT
data into it, and then do INSERT
SELECT
into final table. Temporary table may have Log engine and INSERT
into that "staging" table will work faster than into final MergeTree
table.
It is relatively easy to add possibility to skip unknown fields into code (something like setting 'format_skip_unknown_fields').