Youtube Scraper

13 Responses to “Youtube Scraper”

• Nils

  4 years, 10 months ago.

  uhm.. doesn’t work for me..
  I get a blank page..
• busin3ss

  4 years, 10 months ago.

  uhm.. doesn’t work for me..
  I get a blank page..

  Nils you are right, I was missing this line:
  $youtube = fopen($url, “r”);
  I just updated the code with the fix.
• Jagged55

  4 years, 10 months ago.

  Thanks for the code…I am anxious to use it!

  Is this code working correctly? I am getting a blank page and
  am not sure if it is an error that I made or if the code still
  needs more updating.

  There is a very good chance that I messed up so forgive me if
  it is my fault
• ShinZaiaku

  4 years, 8 months ago.

  Warning: preg_match() expects parameter 2 to be string, resource given in /home/public_html/004/youtube.php on line 5

  I’m getting this error.
• Arpit

  4 years, 8 months ago.

  I don’t have any idea of how to use this script. Can you please give us some detailed instruction for doing it? I have messaged you on Digital point forum about this. Please guide me.
• busin3ss

  4 years, 8 months ago.

  I don’t have any idea of how to use this script. Can you please give us some detailed instruction for doing it? I have messaged you on Digital point forum about this. Please guide me.

  It’s actually really easy, just copy the code and save it on a file (youtube.php for example). Then wherever you want to insert a Youtube video related to a keyword, just add this:

  require_once(‘youtube.php’); // assuming your file is called youtube.php

  And then just wherever you want to see the video add this:

  youtube(‘bmw’); // this will include a youtube video about BWM
• Arpit

  4 years, 8 months ago.

  Will this make my blog automated? Or should I have to add any cronjob or something to control the frequency of updating my blog?
• Zaiaku

  4 years, 7 months ago.

  No it wont post automatically but will give your site or page dynamic content.
• Wayne

  3 years, 3 months ago.

  Thanks for this. I’ve been wondering how to get something like this working for a while.

  Wayne
• Matt Longley

  3 years, 3 months ago.

  Thanks for the script, that will come in handy on a new project that I am working on. =)
• Mike

  3 years ago.

  This code doesn’t work.Just gives me a blank page
• Scraper code in php

  2 years, 11 months ago.

  have not done many PHP projects but I always think that PHP is really good for web programming even though I mostly program in Java and .NET.

  I am not a good PHP programmer, but to write a simple web page scraper in PHP is very straightforward.

  First, I defined my HTTP get/post function

  function http_post_content($url,$data) {
  $data = http_build_query($data);
  $aContext = array(
  ‘http’ => array(
  ‘proxy’ => ‘proxyserver:8080′,
  ‘request_fulluri’ => True,
  ‘method’=>’POST’,
  ‘header’=>
  “Content-type: application/x-www-form-urlencoded\r\n”
  .”Content-Length: ” . strlen($data) . “\r\n”,
  ‘content’ => $data
  ),
  );
  $cxContext = stream_context_create($aContext);
  $content = file_get_contents($url, FILE_TEXT, $cxContext);
  return $content;

  /*
  $fp = @fopen($url, ‘rb’, false, $cxContext);
  if (!$fp) {
  throw new Exception(“Problem with $url, $php_errormsg”);
  }
  $content = @stream_get_contents($fp);
  if ($content === false) {
  throw new Exception(“Problem reading data
  from $url, $php_errormsg”);
  }
  */
  }
  In the http array I can define the proxy server settings, method which can be post or get, and the content.

  I use file_get_contents to retrieve the web page instead of cURL, which is more powerful.

  To test it,

  $url=”http://biz.thestar.com.my/marketwatch/main.asp”;
  $data=array(‘bns’=>’2′,
  ‘clp’=>’1′,
  ‘klseViewDate’=>’1/30/2008′
  );
  $content = http_post_content($url,$data);
  $htmlDoc = new DomDocument();
  @$htmlDoc->loadHTML($content);
  $xPath = new DOMXPath($htmlDoc);
  $counters = $xPath->evaluate(‘//table[@id="Table2"]
  /tr/td[2]/center/table/tr/td/span
  [@class="text"]/table/tr/td/a’);
  for ($i = 0; $i length; $i++){
  print($counters->item($i)->nodeValue.’‘);
  }
  I pass in the URL and the post data, then I use XQuery to retrieve the information that I want.

  Note the HTML may not be well-formed, so I suppress the warning by prefixing a @ in front.

  One of the catch here is the correct XQuery/XPath to be used. You can always find out using Solvent, which is a very good FireFox plug-in for web page scraping.
  quote]
• sonmen

  2 years, 2 months ago.

  if you guys are looking for good tools to get back links, i found some good ones at this website here

  http://www.webthangs.com