Databricks
About this role
Databricks sells the data and AI platform, and this team runs Databricks on Databricks: the internal
Data Intelligence Platform holding every business and product metric the company runs on. You design
and operate the metrics store that lets all business units and engineering teams bring detailed
metrics into one place with quality, introspection and query performance, and build the tooling to
run it at scale across multiple clouds, geographies and deployments. The team is also a large
in-house production customer of Databricks itself, so what you find shapes the actual product. The
work spans logging, orchestration, data transformation, the metric store, governance platforms and
consumption layers. Apply if you want data platform engineering where you are both the builder and the
most demanding user.
Data Intelligence Platform holding every business and product metric the company runs on. You design
and operate the metrics store that lets all business units and engineering teams bring detailed
metrics into one place with quality, introspection and query performance, and build the tooling to
run it at scale across multiple clouds, geographies and deployments. The team is also a large
in-house production customer of Databricks itself, so what you find shapes the actual product. The
work spans logging, orchestration, data transformation, the metric store, governance platforms and
consumption layers. Apply if you want data platform engineering where you are both the builder and the
most demanding user.
Who this is for
Requirements. 12+ years of industry experience. 4+ years of experience building large scale
distributed systems. Experience with large scale messaging systems such as Kafka, RabbitMQ or
commercial equivalents.
⚠️ A years trap on this one. The requirement list carries both "12+ years of industry experience" and
"4+ years of experience building large scale distributed systems". Any tool that takes the smallest
figure in a posting would list this as a 4 year job. It is a 12 year job with a 4 year distributed
systems specialisation inside it, and that is how it is listed here.
The impact, as the posting frames it. Design and run the Databricks metrics store, letting all
business units and engineering teams bring detailed metrics into a common platform for sharing and
aggregation with high quality, introspection and query performance. Design and run the cross company
Data Intelligence Platform containing every business and product metric used to run Databricks,
balancing data protection against shareability as the company transitions to being public. Develop
tooling and infrastructure to manage and run Databricks on Databricks at scale across multiple clouds,
geographies and deployments. You would build a variety of tools spanning logging, orchestration, data
transformation, metric store, governance platforms and data consumption layers, working with
Databricks product teams, data science and applied AI.
A useful detail. The team functions as a large, production, in-house customer that dogfoods Databricks
and guides the future direction of the product, so platform gaps you find turn into product work.
Location. Bengaluru, India, with the hiring entity listed as Databricks India Private Limited.
Who this is for. A staff level data or backend engineer with over a decade of experience who wants
internal platform scale and influence on a commercial product at the same time. Note Databricks uses
the same titles at very different bars: it has run "Staff Software Engineer" at 10 to 12 years and
"Senior Staff Software Engineer" at 15, so the title tells you less than the years do.
distributed systems. Experience with large scale messaging systems such as Kafka, RabbitMQ or
commercial equivalents.
⚠️ A years trap on this one. The requirement list carries both "12+ years of industry experience" and
"4+ years of experience building large scale distributed systems". Any tool that takes the smallest
figure in a posting would list this as a 4 year job. It is a 12 year job with a 4 year distributed
systems specialisation inside it, and that is how it is listed here.
The impact, as the posting frames it. Design and run the Databricks metrics store, letting all
business units and engineering teams bring detailed metrics into a common platform for sharing and
aggregation with high quality, introspection and query performance. Design and run the cross company
Data Intelligence Platform containing every business and product metric used to run Databricks,
balancing data protection against shareability as the company transitions to being public. Develop
tooling and infrastructure to manage and run Databricks on Databricks at scale across multiple clouds,
geographies and deployments. You would build a variety of tools spanning logging, orchestration, data
transformation, metric store, governance platforms and data consumption layers, working with
Databricks product teams, data science and applied AI.
A useful detail. The team functions as a large, production, in-house customer that dogfoods Databricks
and guides the future direction of the product, so platform gaps you find turn into product work.
Location. Bengaluru, India, with the hiring entity listed as Databricks India Private Limited.
Who this is for. A staff level data or backend engineer with over a decade of experience who wants
internal platform scale and influence on a commercial product at the same time. Note Databricks uses
the same titles at very different bars: it has run "Staff Software Engineer" at 10 to 12 years and
"Senior Staff Software Engineer" at 15, so the title tells you less than the years do.
Apply on company site
Opens databricks.com, the employer's own application page. Applying is always free.