icrunchdata Network
New Castle County, DE, USA
Dec 07, 2019
Full-time
Job Title : Kafka Admin/ Developer Duration: Full Time Location: Delaware Qualifications 9 overall IT experience as programmer or System Admin. 2 years of solid Kafka Admin experience in managing critical 24/7 applications Design, build, assemble, and configure application or technical architecture components using business requirements. Hands-on experience with Kafka clusters build. Experience in implementing security & authorization (permission based) on Kafka cluster. Experience in Kafka, zookeepers, Kafka connect, schema registry Avro schemas. High availability cluster setup, maintenance and ongoing support Create topics, setup redundancy cluster, deploy monitoring tools, alerts Has good knowledge of best practices Exposure to Kafka APIs Hands on experience in standing up and administrating Kafka platform which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management(ACL) Knowledge of Kafka API (development experience is a plus) Exposure to Cloudera Hadoop is a big plus Experience in Jenkins, GitHub Hands experience on AWS and Kafka container environment is plus Hands on any scripting language Scripting knowledge KSH / JAVA / Python. Hands on experience on building Kafka connectors is plus. Proven track record of sound, effective decision making. Excellent listening and communication skills. o Must be able to communicate technical information clearly, able to 'translate' between diverse groups of technical and non-technical individuals. o Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations to a vast array of individuals. o Partner with business units in order to improve the effectiveness of business decisions. o Ability to structure documents to effectively communicate with senior leadership and drive alignment and decision making. Responsibilities Manage large scale multi-nodes Kafka cluster environments. Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring. Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster. Creation of key performance metrics, measuring the utilization, performance and overall health of the cluster. Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure. Research and recommend innovative, and where possible, automated approaches for system administration tasks. Ability to closely calibrate with Kafka developers. Provide guidance in the creation and modification of standards and procedures Proactively monitor and setup alerting mechanism for Kafka Cluster and supporting hardware to ensure system health and maximum availability Proven ability to lead multiple high priorities initiative with aggressive timelines leveraging an agile framework. Comfortable performing in a fast paced, dynamic and ambiguous business environment. Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable. Demonstrated a product mindset with an ability to set forward thinking and direction. Regards, Pradeep Kumar Quantum World Technologies Inc. 199 West Hillcrest Dr Suite 0112, Thousand Oaks CA 91360 www.quantumworld.us Office: 805-222-0532 Ext-151 Fax : 805-834-0532 E: pradeepkumarquantumworld.us - provided by Dice