java - Jsoup with a plugin -


i'm using jsoup scrape online data different stores, i'm having trouble figuring out how programmatically replicate user. data manually (after logging in), user must select store a tree pops up.

as best can tell, tree not hard-coded site built interactively when computer interacts server. when table in "view page source," there no entries. when inspect tree, see html , seems come "fancytree" plugin.

as best can tell tracking activity on developer tools -- network, next step "get" request doesn't change url, i'm not sure how store selection being transferred.

any advice on how jsoup or java programmatically interact table extremely helpful, thank you!

jsoup can parse original source file, not dom. in order parse dom, you'll need render page htmlunit. can parse html content jsoup.

// load page using html unit , fire scripts webclient webclient = new webclient(); htmlpage mypage = webclient.getpage(myurl);  // convert page generated html , convert document doc = jsoup.parse(mypage.asxml());  // html content system.out.println(doc.html());  // clean resources         webclient.close(); 

see parsing javascript generated page jsoup.


Comments