Big Data Engineers or Architects
The core stack includes: • Apache Iceberg (table format, ACID, time travel, schema evolution) • Project Nessie (as the Iceberg catalog/metastore—replacing Hive Metastore) • Apache Ranger (security and audit layer for Trino, Iceberg, and the lakehouse) • Trino (distributed SQL engine) • Ray (scalable Python/AI compute) • Apache AirByte (data ingestion) • Apache Airflow (workflow orchestration) • Apache Pinot (real-time OLAP) • Apache Superset (BI/visualization) • Amundsen & OpenLineage (data governance, discovery, lineage) • Pure Storage FlashBlade/FlashArray (object/block storage) • OpenStack (IaaS, K8s orchestration)
Apply tot his job
Apply To this Job