razor - How can I retrieve and parse just the html returned from an URL? -


i want able programmatically (without displaying in browser) send url such http://www.amazon.com/s/ref=nb_sb_noss_1?url=search-alias%3daps&field-keywords=platypi&sprefix=platypi%2caps&rh=i%3aaps%2ck%3aplatypi" , in string (or more appropriate data type?) html results of page (the interesting part, anyway) parse , reformat selected parts of matched text , images (which link appropriate page). want razor/web pages, if makes difference.

iow, sort of screen-scraping question, "behind-the-screen" scraping.

is possible? how? 100 point post-answer-bonus awarded (or helpful) answer.

use webclient class (or .net 4.5's better httpclient class) download html, use html agilitypack parse it


Comments

Post a Comment

Popular posts from this blog

Java sticky instances of class com.mysql.jdbc.Field aggregating -

i noticed (via jmap+jhat) app leaking storing many instances com.mysql.jdbc.field  class - double checked code make sure closing preparedstatements, find few missing didn't change outcome. - preparedstatement created , closed right away - several others created @ start , reused many times - using org.apache.tomcat.jdbc.pool.datasource connection pool what can cause type of behavior? are closing of preparedstatements / result sets using: preparedstatement stmt (possible assignment here); try { // work prepared statement resultset rs; try { while (rs.next()) ... // process results } { rs.close(); } } { stmt.close(); } so guarantee result sets closed when finished (regardless of exceptions) , statements closed (regardless of exceptions)? there other ways write that, idea same. if you're doing of properly, unless have many references it's taking inordinate amount of memory, it's ok , nothing needs done it.
Read more