admin管理员组

文章数量:1384238

I want to scrape the data from the webpages and run a script java also using background mechanism like service in Android App. I can do that using WebView but then it needs to run on main thread. I want to authenticate and get the cookies from the web portal and generate cookies on html content. I have tried Jsoup which can parse HTML content only, but not able to inject javascript on html element. Also I want to execute ajax calls.

I know this might not be possible by using any single library. However, is there any approach I can follow by using combination of library for different steps and implement it?

I want to scrape the data from the webpages and run a script java also using background mechanism like service in Android App. I can do that using WebView but then it needs to run on main thread. I want to authenticate and get the cookies from the web portal and generate cookies on html content. I have tried Jsoup which can parse HTML content only, but not able to inject javascript on html element. Also I want to execute ajax calls.

I know this might not be possible by using any single library. However, is there any approach I can follow by using combination of library for different steps and implement it?

  • javascript
  • html
  • web-scraping
  • cookies
  • android-webview
Share Improve this question edited Mar 19 at 16:33 Mister Jojo 22.6k6 gold badges25 silver badges44 bronze badges asked Mar 19 at 13:05 user_8275user_8275 2914 silver badges16 bronze badges 1
  • Are you familiar with the term "headless browser"? – ADyson Commented Mar 19 at 15:28
Add a comment  | 

1 Answer 1

Reset to default 1

You can't execute JavaScript or handle AJAX fully with Jsoup alone. Instead, use a headless browser like Selenium (via a remote server) or offload the task to a Node.js backend with Puppeteer/Playwright. For authentication and cookie handling, use OkHttp in combination with a web scraping service. To run it in the background, use WorkManager or a Foreground Service in Android. Running a headless browser directly on Android is impractical, so a backend approach is often the best solution.

本文标签：

版权声明：本文标题：javascript - How to scrape html and JS without WebView in background when the application is not running in android - Stack Over 内容由网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：http://www.betaflare.com/web/1744455854a2606987.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。