Hadoop Jobs

I'm looking for an IT freelancer with experience in infrastructure assessment, particularly in automation testing. Your primary task will be to evaluate our IT landscape and develop a comprehensive understanding of its network security, system performance, and data backup and recovery systems. Key Responsibilities: - Conduct thorough infrastructure assessment - Generate insights on potential vulnerabilities and performance bottlenecks - Suggest improvements and solutions for identified issues In addition, you are expected to automate testing of specific features in our application. This includes user authentication, data validation, and error handling. The ideal candidate should have: - Proficiency in IT infrastructure assessment - Experience with automation testing using Sel...

I am in need of a data engineer proficient in AWS to assist me in setting up a data backup system using AWS S3. Key requirements: - Proficiency in AWS services, particularly S3 - Experience with data engineering and backup processes The primary goal of this project is to set up a data backup system using AWS S3. The backup needs to be accessible and updated weekly. I'm looking for an experienced professional who can efficiently set up and manage this system. The successful candidate will need to have a good understanding of AWS services, particularly S3, and will have experience in data engineering and backup processes.

I'm seeking intermediate level big data engineers who can tackle essential tasks within the domain. The ideal candidate for this project should be able to: - Perform data analysis: This includes understanding, interpreting, and presenting data to inform decision-making. - Manage data integration: The candidate should be capable of combining data from various sources to create a cohesive dataset. - Develop data visualization: The engineers will need to create meaningful and understandable visual representations of the analyzed data. The necessary skills for this role are: - Proficient in Python: The candidate should be well-versed in Python programming language to work with our system. - Knowledge of Hadoop: Experience with Hadoop is a must for this position to handle the data integ...

I'm seeking a skilled professional to perform predictive analytics on a small dataset (less than 1GB) using Spark on the AWS EMR Cloud Platform. Specifically, I need assistance in setting up an EMR cluster and doing a Spark job on it. Your expertise should include: - Experienced knowledge in AWS services, including EC2, S3, and especially EMR. - Proficiency in handling Spark Jobs and understanding its complexities. - Prior experience in predictive analytics. Please underscore your relevant jobs and mention how you managed similar challenges on this project.