Usa Research Triangle Park Data Engineer Jobs Vacancy in Company القاهرة
Company القاهرة urgently required following position for Usa Research Triangle Park Data Engineer. Please read this job advertisement carefully before apply. There are some qualifications, experience and skills requirement that the employers require. Does your career history fit these requirements? Ensure you understand the role you are applying for and that it is suited to your skills and qualifications.
Follow the online directions, complete all the necessary fields, and provide all relevant information so your application is submitted correctly. When you click the 'Apply this Job' button (open in new window) you will be taken to the online application form. Here you will be asked to provide personal and contact details, respond to employment-related questions, and show how you meet the key selection criteria.
Usa Research Triangle Park Data Engineer Jobs Vacancy in Company القاهرة Jobs Details:
- **Job Description**
Ready to change the way the world works? This is your chance to establish innovative new technology products, as well as your career, with the world\'s second largest software-maker. Hone your expertise alongside fellow talented professionals, where you\'ll develop some of the most exciting software solutions on the market. At IBM and The Weather Company, we\'re strongly committed to the advancement of open Internet standards and applications.
The Weather Company (an IBM Business) is seeking a Data Engineer to utilize skills in DevOps and data management/engineering to work with architects, developers and other team members to design, build, and operationalize solutions for strategic enterprise data processing in geospatial data. Work will include development and playing a key role in the design, installation, testing and maintenance of software systems to aggressively manage the business needs for controlled structure in complex environments.
Location: Yorktown Heights, NY or Littleton, MA
You will be a part of a distributed team participating in BigData (Hadoop,SPARK) clusters development and deployment projects with large amount of data (> 1PB) following DevOps principles (on-premise and cloud)
Extend the BIG DATA line with some data formats: Parquet, ORC, Avro,
Extend the Analytics line with spatial topics: Spatial Analytics, GIS, GDAL
Proven experience in Agile and lean development
Good technical aptitude coupled with the ability to quickly understand new technology
Excellent communication, teamwork and a results-oriented attitude
Proficiency in problem solving and debugging
**Required Technical and Professional Expertise**
Bachelor’s degree in information technology, business, or related field, or equivalent combination of education and experience required.
10+ years data quality, data management, data/sw engineering or similar level experience required.
Experience in Geospatial analytics is preferred
**Preferred Tech and Prof Experience**
DevOps & automation: Kubernetes, Git, Github, Jenkins, Terraform,Chef,Docker
Experience in designing, running and troubleshooting Hadoop/SPARK clusters
BIGDATA: HBase, spark, hive, elastic search
Cloud: IBM Cloud, AWS, S3, Swagger
Strong understanding of Linux OS core principles, performance and tuning
Strong programming skills in the following languages: Python, Scala, SQL, Java, bash, c+Experience with Analytics : SPARK, python, scala, Jupyter notebooks
Strong knowledge of RDBMS management and application development: Postgres, MySQL, DB2
IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.