We are creating a partitioned table with s3 as external_location.
table location has many partition folders already created.
hive allows us to add selected partitions using
ALTER TABLE my_table ADD
PARTITION (partkey=keyval1)
PARTITION (partkey=keyval2)
PARTITION (partkey=keyval3)
similar to this how can I use create_empty_partition to add multiple partitions ?
we are able to use this for one partition using
call system.create_empty_partition('myschema, ‘my_table’, ‘partkey’, ‘keyval1’)
we are not using call system.sync_partition_metadata as it takes time to sync all partitions when the list of partitions is too big and for the use case we are not interested in all partitions .
looking for ways to do this for multiple partitions.
Appreciate any pointers.