Senior Software Engineer ( Webscraping )

Senior Software Engineer ( Webscraping ) Remote4 months ago
Technology & Design Full-time 50-200 employees · Staffing & Recruiting Actively recruiting
Company Description Required skillset Java 1 Docker 1 AWS 1 s3 1 Lambda 1 php 1 Symfony 1 Python 1 Flask 1 Redis 1
Job Description The candidate should be comfortable with RESTful API design best practices, fundamental design patterns, algorithms, unit testing, and automated testing. They should also have knowledge of methods, headers, responses, and debugging, as well as the JSON response data format. Familiarity with Redis and Swagger/OpenAPIV3 Specification is also desired.
Responsibilities:
Develop and maintain web scraping tools and applications using proxy technology and fingerprinting techniques. Design and implement Docker and Docker Compose environments for distributed computing. Utilize AWS services such as S3, IAM, SSH, and Lambda to create scalable and secure systems. Develop and maintain applications using one or many of bin/console, Go Lang, Python, Flask, Requests, Puppeteer (pyppeteer), JS Rendering, DOM Traversal, Element Selection, and Headless Chrome. Create and maintain RESTful APIs using best practices. Utilize fundamental design patterns and algorithms to build efficient and scalable systems. Write unit tests and automated tests to ensure code quality. Troubleshoot and debug methods, headers, responses, and JSON response data format. Utilize Redis for caching and data storage. Implement Swagger/OpenAPIV3 Specification for API documentation. Qualifications:
Expertise in web scraping, proxy technology, and fingerprinting. Intermediate knowledge of distributed computing, Docker, Docker Compose, AWS, S3, IAM, SSH, Lambda,Go Lang, bin/console, Python, Flask, Requests, Puppeteer (pyppeteer), JS Rendering, DOM Traversal, Element Selection, and Headless Chrome. Familiarity with RESTful API design best practices, fundamental design patterns, algorithms, unit testing, and automated testing. Knowledge of methods, headers, responses, and debugging, as well as the JSON response data format. Familiarity with Redis and Swagger/OpenAPIV3 Specification. Strong problem-solving skills. Bachelor's or Master's degree in Computer Science or a related field. #J-18808-Ljbffr