Software Development Engineer III

This is the senior data engineering rung at Sigmoid, which builds large scale data platforms for enterprises using cloud and open source technology. The posting reads as a straight big data engineering job with no management attached: you work across engineering, design, development and deployment, and provide the technical depth in the big data space. The named stack is broad and specific, Apache Spark, Kafka, Flink, the Hadoop stack including MapReduce, HDFS, Hive, HBase, Flume and Sqoop, plus NoSQL stores such as Cassandra. It insists twice on being a hands on coder, in Java, Python, C plus plus or Scala, with core Java or Scala called out separately. If you have spent six or more years building pipelines and want to keep writing code rather than move into leading a team, this posting is explicitly aimed at you.

Required by the posting: 6 or more years of experience, recorded in Sigmoid's own job metadata as a 6 to 9 year band. An engineering bachelor's or master's degree in computer science or IT. Hands on coding experience in Java, Python, C plus plus or Scala, with hands on experience in core Java or Scala named separately. Strong work experience in technical development, which the posting clarifies in brackets as coding. Technical expertise in the big data space: Apache Spark, Kafka, Flink, the Hadoop stack including MapReduce, HDFS, Hive, HBase, Flume and Sqoop, and NoSQL stores such as Cassandra and HBase. Experience in application development and support, integration development and data management. Experience designing APIs, abstractions and integration patterns for distributed computing problems. Experience defining technical requirements, data extraction and transformation, automating and productionising jobs, and exploring new big data technologies in a parallel processing environment. Work experience with third party libraries and frameworks.

The posting also asks for a strategic thinker able to think unconventionally, the same phrasing Sigmoid uses on its mid level posting.

Location: Bengaluru. Office days are not published.

Who should apply: data engineers six to nine years in who want to stay technical. Sigmoid is a services and solutions company, so the work spans client industries rather than one product, which suits engineers who like variety and frustrates those who want to own one system for years. Its 3 to 5 year and 2 to 5 year engineer roles are also on today's list if this band is above you.