Overview: This position will be a part of our Enterprise Data Services team and be responsible for implementation and support of the Enterprise Hadoop environment. This includes design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration. The administrator will work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels. The administrator will apply a strong understanding of Hadoop eco system such as HDFS, YARN, Map Reduce, HBase, Zookeeper, Pig, Impala, and Hive. Primary Responsibilities: Installing, administering, and supporting Linux operating systems/hardware in an enterprise environment System Administration and programming skills. Storage, performance tuning and capacity management of Hadoop clusters and Hadoop MapReduce routines Setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level Solve production problems when needed 24x7 Develop and document best practices Deep understanding of big data, Hadoop Architecture and YARN/Map Reduce concept Implement High Availability techniques, Hadoop cluster connectivity and tuning, network requirements, failover, active-active HDFS support, maintenance, backup, restore, disaster recovery, failover management and troubleshooting Education and Experience Required: Minimum of an Associate's degree and 6 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 8 years' higher education and/or work experience, including a minimum of 6 years' systems analysis/application development experience Education and Experience Preferred: 10 years of professional experience in IT with focus on software development Solutions, Infrastructure Domain and Sub Domain Architects with emerging tech and software defined everything experience in the following areas: Presentation, Application/ Integration/ Database Server, Platforms (Server/Client/HW/OS/Container), Storage, and Network Create technical documentation, including system architecture and design, use case diagrams, sequence diagrams, and class diagrams Integrate disparate enterprise applications and data sources and incorporate SOA principles
Nov 19, 2019
Full-time
Overview: This position will be a part of our Enterprise Data Services team and be responsible for implementation and support of the Enterprise Hadoop environment. This includes design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration. The administrator will work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels. The administrator will apply a strong understanding of Hadoop eco system such as HDFS, YARN, Map Reduce, HBase, Zookeeper, Pig, Impala, and Hive. Primary Responsibilities: Installing, administering, and supporting Linux operating systems/hardware in an enterprise environment System Administration and programming skills. Storage, performance tuning and capacity management of Hadoop clusters and Hadoop MapReduce routines Setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level Solve production problems when needed 24x7 Develop and document best practices Deep understanding of big data, Hadoop Architecture and YARN/Map Reduce concept Implement High Availability techniques, Hadoop cluster connectivity and tuning, network requirements, failover, active-active HDFS support, maintenance, backup, restore, disaster recovery, failover management and troubleshooting Education and Experience Required: Minimum of an Associate's degree and 6 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 8 years' higher education and/or work experience, including a minimum of 6 years' systems analysis/application development experience Education and Experience Preferred: 10 years of professional experience in IT with focus on software development Solutions, Infrastructure Domain and Sub Domain Architects with emerging tech and software defined everything experience in the following areas: Presentation, Application/ Integration/ Database Server, Platforms (Server/Client/HW/OS/Container), Storage, and Network Create technical documentation, including system architecture and design, use case diagrams, sequence diagrams, and class diagrams Integrate disparate enterprise applications and data sources and incorporate SOA principles
Overview: This position will be a part of our Enterprise Data Services team and be responsible for implementation and support of the Enterprise Hadoop environment. This includes design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration. The administrator will work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels. The administrator will apply a strong understanding of Hadoop eco system such as HDFS, YARN, Map Reduce, HBase, Zookeeper, Pig, Impala, and Hive. Primary Responsibilities: Installing, administering, and supporting Linux operating systems/hardware in an enterprise environment System Administration and programming skills. Storage, performance tuning and capacity management of Hadoop clusters and Hadoop MapReduce routines Setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level Solve production problems when needed 24x7 Develop and document best practices Deep understanding of big data, Hadoop Architecture and YARN/Map Reduce concept Implement High Availability techniques, Hadoop cluster connectivity and tuning, network requirements, failover, active-active HDFS support, maintenance, backup, restore, disaster recovery, failover management and troubleshooting Education and Experience Required: Minimum of an Associate's degree and 6 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 8 years' higher education and/or work experience, including a minimum of 6 years' systems analysis/application development experience Education and Experience Preferred: 10 years of professional experience in IT with focus on software development Solutions, Infrastructure Domain and Sub Domain Architects with emerging tech and software defined everything experience in the following areas: Presentation, Application/ Integration/ Database Server, Platforms (Server/Client/HW/OS/Container), Storage, and Network Create technical documentation, including system architecture and design, use case diagrams, sequence diagrams, and class diagrams Integrate disparate enterprise applications and data sources and incorporate SOA principles
Nov 19, 2019
Full-time
Overview: This position will be a part of our Enterprise Data Services team and be responsible for implementation and support of the Enterprise Hadoop environment. This includes design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration. The administrator will work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels. The administrator will apply a strong understanding of Hadoop eco system such as HDFS, YARN, Map Reduce, HBase, Zookeeper, Pig, Impala, and Hive. Primary Responsibilities: Installing, administering, and supporting Linux operating systems/hardware in an enterprise environment System Administration and programming skills. Storage, performance tuning and capacity management of Hadoop clusters and Hadoop MapReduce routines Setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level Solve production problems when needed 24x7 Develop and document best practices Deep understanding of big data, Hadoop Architecture and YARN/Map Reduce concept Implement High Availability techniques, Hadoop cluster connectivity and tuning, network requirements, failover, active-active HDFS support, maintenance, backup, restore, disaster recovery, failover management and troubleshooting Education and Experience Required: Minimum of an Associate's degree and 6 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 8 years' higher education and/or work experience, including a minimum of 6 years' systems analysis/application development experience Education and Experience Preferred: 10 years of professional experience in IT with focus on software development Solutions, Infrastructure Domain and Sub Domain Architects with emerging tech and software defined everything experience in the following areas: Presentation, Application/ Integration/ Database Server, Platforms (Server/Client/HW/OS/Container), Storage, and Network Create technical documentation, including system architecture and design, use case diagrams, sequence diagrams, and class diagrams Integrate disparate enterprise applications and data sources and incorporate SOA principles
Overview: A proficient Informatica Data Quality Developer (IDQ Developer) needs to be experienced using proven techniques and tools to measure, control, monitor and improve the quality of data needed for key business processes. Primary Responsibilities: The primary tasks associated with this role is to use Informatica Data Quality to profile the project source data, define or confirm the definition of the metadata, cleanse and accurately check the project data, check for duplicate or redundant records, and provide information on how to proceed with back end ETL processes. Other responsibilities include: Partner with data stewards to provide summary results of data quality analysis, which will be used to make decisions regarding how to measure business rules and quality of the data. Implement data quality processes including translation, parsing, analysis, standardization and enrichment at point of entry and batch modes; Deploy mappings that will run in a scheduled, batch, or real-time environment. Document all mappings, mapplets, and rules in detail and hand over documentation to the customer. Collaborate with various business and technical teams to gather requirements around data quality rules and propose the optimization of these rules if applicable, then design and develop these rules with IDQ. Design and develop custom objects and rules, reference data tables and create/import/export mappings. As per business requirements, perform thorough data profiling with multiple usage patterns, root cause analysis and data cleansing and develop scorecards utilizing Informatica. Develop "matching" plans, help determine best matching algorithm, configure identity matching and analyze duplicates. Build human task workflows to implement data stewardship and exception processing. Develop an understanding of data quality practices, reviewing current industry trends. Complete other related duties as assigned. Education and Experience Required: Bachelor's degree and a minimum of 5 years' professional experience, or in lieu of a degree, a combined minimum of 9 years' higher education and/or work experience, including a minimum of 5 years' professional experience Minimum of 2 years' managerial, supervisory and/or work leadership experience Previous experience working with Informatica Data Quality(IDQ) toolset and proficiency in IDQ development around data profiling, cleansing, parsing, standardization, verification, matching and data quality exception monitoring and handling Demonstrated analytical and problem solving ability Education and Experience Preferred: Bachelor degree in Computer Science or Information Technology. Master Degree preferred Informatica Data Quality (IDQ) toolset, version 9.x / 10.x experience Strong understanding of IDQ process and procedures such as define, discovery, profiling, remediation, and monitoring Previous experience using IDQ for source data profiling, creating and applying rules Previous experience installing, configuring, administering, tuning, and troubleshooting any one or more Informatica products: Informatica Data Quality, Master Data Management (MDM), Big Data Management (BDM), Big Data Quality (BDQ), Enterprise Data Catalog (EDC), or AXON Experience with UNIX and Linux Shell Scripting including troubleshooting Good understanding of data governance principals and strong experience on data quality development and issue management and remediation Experience with multiple data platforms including HortonWorks Hadoop, Oracle and SQL Server Experience with the Control-M scheduler LI-KB1
Nov 19, 2019
Full-time
Overview: A proficient Informatica Data Quality Developer (IDQ Developer) needs to be experienced using proven techniques and tools to measure, control, monitor and improve the quality of data needed for key business processes. Primary Responsibilities: The primary tasks associated with this role is to use Informatica Data Quality to profile the project source data, define or confirm the definition of the metadata, cleanse and accurately check the project data, check for duplicate or redundant records, and provide information on how to proceed with back end ETL processes. Other responsibilities include: Partner with data stewards to provide summary results of data quality analysis, which will be used to make decisions regarding how to measure business rules and quality of the data. Implement data quality processes including translation, parsing, analysis, standardization and enrichment at point of entry and batch modes; Deploy mappings that will run in a scheduled, batch, or real-time environment. Document all mappings, mapplets, and rules in detail and hand over documentation to the customer. Collaborate with various business and technical teams to gather requirements around data quality rules and propose the optimization of these rules if applicable, then design and develop these rules with IDQ. Design and develop custom objects and rules, reference data tables and create/import/export mappings. As per business requirements, perform thorough data profiling with multiple usage patterns, root cause analysis and data cleansing and develop scorecards utilizing Informatica. Develop "matching" plans, help determine best matching algorithm, configure identity matching and analyze duplicates. Build human task workflows to implement data stewardship and exception processing. Develop an understanding of data quality practices, reviewing current industry trends. Complete other related duties as assigned. Education and Experience Required: Bachelor's degree and a minimum of 5 years' professional experience, or in lieu of a degree, a combined minimum of 9 years' higher education and/or work experience, including a minimum of 5 years' professional experience Minimum of 2 years' managerial, supervisory and/or work leadership experience Previous experience working with Informatica Data Quality(IDQ) toolset and proficiency in IDQ development around data profiling, cleansing, parsing, standardization, verification, matching and data quality exception monitoring and handling Demonstrated analytical and problem solving ability Education and Experience Preferred: Bachelor degree in Computer Science or Information Technology. Master Degree preferred Informatica Data Quality (IDQ) toolset, version 9.x / 10.x experience Strong understanding of IDQ process and procedures such as define, discovery, profiling, remediation, and monitoring Previous experience using IDQ for source data profiling, creating and applying rules Previous experience installing, configuring, administering, tuning, and troubleshooting any one or more Informatica products: Informatica Data Quality, Master Data Management (MDM), Big Data Management (BDM), Big Data Quality (BDQ), Enterprise Data Catalog (EDC), or AXON Experience with UNIX and Linux Shell Scripting including troubleshooting Good understanding of data governance principals and strong experience on data quality development and issue management and remediation Experience with multiple data platforms including HortonWorks Hadoop, Oracle and SQL Server Experience with the Control-M scheduler LI-KB1
Overview: Provides designs and specifies information systems solutions to solve basic to complex problems or enhancements. Evaluates client requirements and processes, develops and prepares application environments which may involve diverse development platforms, software, hardware, technologies and tools. Completes day-to-day support activities and special projects. Primary Responsibilities: Complete basic to complex systems analysis, design and development. Play a key role as an individual contributor on complex projects. Assist the client in addressing daily problems/issues of any scope. Determine feasible solutions and make recommendations. Direct less experienced resources and coordinate systems development tasks on small to medium scope efforts or on specific phases of larger projects. May project manage small to medium scope efforts. Participate with other Development, operations and Technology staff, as appropriate, in overall systems and integrated testing on small to medium scope efforts or on specific phases of larger projects. Prepare test data and execute detailed test plans. Complete any required debugging. Evaluate and understand complex interrelationships and effects among programs and interfacing applications. Use available resources to develop clear and complete technical and functional specifications for small to medium scope efforts. Review documentation prepared by less experienced staff. Update systems documentation. Prepare charts, tables and diagrams to assist in analyzing problems. May assist in supervision and preparation of logic flowcharts. Prepare assessments and task plans to include required tasks, estimated time frames and effort for assignments. Recommend new technology, policies or processes to benefit the organization and improve deficiencies. Provide consultation services to clients, technicians and Bank departments on basic to intricate functions of supported applications, which may include the review of system capabilities, operational procedures, forms, marketing materials and/or cost analysis. Follow and promote the use of development standards and procedures. Maintain very good working knowledge of the supporting application(s), development environments and the supported client environment. Understand and adhere to the Company's risk and regulatory standards, policies and controls in accordance with the Company's Risk Appetite. Identify risk-related issues needing escalation to management. Promote an environment that supports diversity and reflects the M&T Bank brand. Maintain M&T internal control standards, including timely implementation of internal and external audit points together with any issues raised by external regulators as applicable. Complete other related duties as required, which may include participating in due diligence, cost/benefit analysis, vendor analysis or business study activities. Scope of Responsibilities: The position works under the supervision of the Technology Team Lead and may receive general direction from a more experienced team member. The jobholder is competent to work independently on most all high level systems analysis and technical phases of development and is expected to understand the business supported and its' terminology. The position is capable of managing the activities of others on a project basis for small to medium scope efforts and may lead project activities. The jobholder may assist or help train less experienced staff. The jobholder interacts with other technology personnel, clients and occasionally vendors. Education and Experience Required: Minimum of an Associate's degree and 4 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 6 years' higher education and/or work experience, including a minimum of 4 years' systems analysis/application development experience Familiar with application development software and hardware problems Proficiency with personal computers as well as pertinent project management, word processing and spreadsheet software Capable of working on multiple projects of a moderately complex to complex nature Strong problem-solving skills to assist in issue resolution Strong verbal and written communication skills, with prior experience presenting to the target audience Strong organizational and time management skills Detail-oriented Strong lateral thinking skills Experience coordinating between Applications and business units Experience recommending and implementing systems solutions Experience driving project milestones and delivery dates Education and Experience Preferred: 2 years in Hadoop administration Experience with - Cloudera Hadoop(CDH), Cloudera Manager, Informatica Bigdata Edition(BDM), HDFS, Yarn, MapReduce, Hive, Impala, Sqoop, Spark, Kafka, HBase, Tableau, Kerberos, Active Directory, Sentry, TLS/SSL, Linux/RHEL, Unix Windows, SBT, Maven, Jenkins, Shell Scripting, IDE, Git, SVN Must have strong problem-solving and analytical skills Must have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions. Must be proficient in writing Unix shell scripts
Nov 19, 2019
Full-time
Overview: Provides designs and specifies information systems solutions to solve basic to complex problems or enhancements. Evaluates client requirements and processes, develops and prepares application environments which may involve diverse development platforms, software, hardware, technologies and tools. Completes day-to-day support activities and special projects. Primary Responsibilities: Complete basic to complex systems analysis, design and development. Play a key role as an individual contributor on complex projects. Assist the client in addressing daily problems/issues of any scope. Determine feasible solutions and make recommendations. Direct less experienced resources and coordinate systems development tasks on small to medium scope efforts or on specific phases of larger projects. May project manage small to medium scope efforts. Participate with other Development, operations and Technology staff, as appropriate, in overall systems and integrated testing on small to medium scope efforts or on specific phases of larger projects. Prepare test data and execute detailed test plans. Complete any required debugging. Evaluate and understand complex interrelationships and effects among programs and interfacing applications. Use available resources to develop clear and complete technical and functional specifications for small to medium scope efforts. Review documentation prepared by less experienced staff. Update systems documentation. Prepare charts, tables and diagrams to assist in analyzing problems. May assist in supervision and preparation of logic flowcharts. Prepare assessments and task plans to include required tasks, estimated time frames and effort for assignments. Recommend new technology, policies or processes to benefit the organization and improve deficiencies. Provide consultation services to clients, technicians and Bank departments on basic to intricate functions of supported applications, which may include the review of system capabilities, operational procedures, forms, marketing materials and/or cost analysis. Follow and promote the use of development standards and procedures. Maintain very good working knowledge of the supporting application(s), development environments and the supported client environment. Understand and adhere to the Company's risk and regulatory standards, policies and controls in accordance with the Company's Risk Appetite. Identify risk-related issues needing escalation to management. Promote an environment that supports diversity and reflects the M&T Bank brand. Maintain M&T internal control standards, including timely implementation of internal and external audit points together with any issues raised by external regulators as applicable. Complete other related duties as required, which may include participating in due diligence, cost/benefit analysis, vendor analysis or business study activities. Scope of Responsibilities: The position works under the supervision of the Technology Team Lead and may receive general direction from a more experienced team member. The jobholder is competent to work independently on most all high level systems analysis and technical phases of development and is expected to understand the business supported and its' terminology. The position is capable of managing the activities of others on a project basis for small to medium scope efforts and may lead project activities. The jobholder may assist or help train less experienced staff. The jobholder interacts with other technology personnel, clients and occasionally vendors. Education and Experience Required: Minimum of an Associate's degree and 4 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 6 years' higher education and/or work experience, including a minimum of 4 years' systems analysis/application development experience Familiar with application development software and hardware problems Proficiency with personal computers as well as pertinent project management, word processing and spreadsheet software Capable of working on multiple projects of a moderately complex to complex nature Strong problem-solving skills to assist in issue resolution Strong verbal and written communication skills, with prior experience presenting to the target audience Strong organizational and time management skills Detail-oriented Strong lateral thinking skills Experience coordinating between Applications and business units Experience recommending and implementing systems solutions Experience driving project milestones and delivery dates Education and Experience Preferred: 2 years in Hadoop administration Experience with - Cloudera Hadoop(CDH), Cloudera Manager, Informatica Bigdata Edition(BDM), HDFS, Yarn, MapReduce, Hive, Impala, Sqoop, Spark, Kafka, HBase, Tableau, Kerberos, Active Directory, Sentry, TLS/SSL, Linux/RHEL, Unix Windows, SBT, Maven, Jenkins, Shell Scripting, IDE, Git, SVN Must have strong problem-solving and analytical skills Must have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions. Must be proficient in writing Unix shell scripts
