Web developer serp_jobs.h1.location_city
serp_jobs.job_alerts.create_a_job
Web developer • austin tx
Java Developer with Web Crawler Experience
Axiom Software Solutions LimitedAustin, Texas, United StatesWeb Developer 3
AbacusAustin, TX, United StatesJava / PHP Web Developer
Luna Data SolutionsAustin, Texas- serp_jobs.job_card.promoted
Senior UX Designer / Senior Web Developer 3
ASB ResourcesAustin, TX, United States- serp_jobs.job_card.promoted
UX / Web Developer
RIT Solutions, Inc.Austin, TX, United StatesFull Stack Web Developer, Ecommerce
CatfaceAustin, Texas, United StatesWeb Developer EAP 8
Hill Country Project Management LLCAustin, Texas, United StatesSr. Web Developer / CMS Administrator
Peak PerformersAustin, TX, United StatesWeb Developer
EbqAustin, Texas, United States- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Comptroller - Front-end Web Applications Developer
CAPPSAustin, TX, United StatesWeb Developer
EBQAustin, TXWeb Developer / PHP Developer / Software Developer
Business IntegraAustin, TX, United StatesSr. Web Developer - Angular10+, Java Spring Boot API,
Motion RecruitmentAustin, Texas, United StatesDigital Web Developer
Veeva SystemsAustin, Texas, United States- serp_jobs.job_card.promoted
Software Developer 3
GovserviceshubAustin, Texas, United StatesWEB Developer -Intl India
Insight GlobalAustin, TX, United StatesWeb Developer
MyTennisLessonsAustin, Texas- serp_jobs.job_card.promoted
Full-Stack.NET Web Developer - Digital Platforms
Intertek GroupAustin, TX, United StatesUX / Web Developer
MediabistroAustin, TX, United States- serp_jobs.job_card.promoted
3D Web Developer
VirtualVocationsAustin, Texas, United StatesJava Developer with Web Crawler Experience
Axiom Software Solutions LimitedAustin, Texas, United States- serp_jobs.job_card.full_time
Role : Java Developer with Web Crawler Experience
Location : Austin TX(Hybrid)
Responsibilities :
1. Web Crawler Development : Design and implement efficient and scalable web crawlers in Java to collect data from various online sources.
2. Data Extraction : Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.).
3. Data Storage and Processing : Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible.
4. Performance Optimization : Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites.
5. Error Handling and Logging : Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations.
6. Data Integrity and Compliance : Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws).
Requirements :
Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient).
Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer.
Strong understanding of HTML, CSS, JavaScript, and web data structures.
Familiarity with data parsing and handling techniques for JSON, XML, and other common formats.
Experience with database technologies (SQL, NoSQL) to store and manage scraped data.
Knowledge of HTTP protocols, headers, proxies, and load handling.