[Remote] Senior Data Engineer – Observability & Security

Note: The job is a remote job and is open to candidates in USA. Colossus Technologies Group is partnering with a large enterprise organization to find a Senior Data Engineer to help build and scale a modern Observability Lakehouse. This role involves designing and operating high-volume log, metric, and trace pipelines, and working closely with SRE, Cloud, and Security teams to turn massive volumes of telemetry into actionable insight. Responsibilities • Design and operate high-volume log, metric, and trace pipelines • Work with distributed data platforms to support threat detection, incident response, and operational intelligence • Shape data models aligned to OpenTelemetry standards • Improve data quality and performance • Build automation that enables scalable, cost-efficient observability at enterprise scale Skills • Experience in data engineering, observability, and security • Ability to design and operate high-volume log, metric, and trace pipelines • Experience with distributed data platforms • Knowledge of threat detection, incident response, and operational intelligence • Ability to shape data models aligned to OpenTelemetry standards • Experience in improving data quality and performance • Ability to build automation for scalable, cost-efficient observability • Experience with Databricks, Spark, OpenTelemetry (OTEL), Delta Lake, Cribl / Vector, Kafka, AWS / Azure / GCP, Python, SQL, CI/CD, Terraform, and Observability Platforms (Splunk, Datadog, Elastic) • Experience in a contract-to-hire role • Interest in building platforms, not just pipelines • Desire to improve security and reliability outcomes Company Overview • At Colossus Technologies Group, we provide top-tier cybersecurity and digital trust staffing, IT consulting, and project management solutions, including privacy, security, and GRC SaaS platform solution implementation. It was founded in 2021, and is headquartered in Boston, Massachusetts, US, with a workforce of 2-10 employees. Its website is http://www.colossustg.com. Apply tot his job Apply To this Job