php - 将参数从命令行传递到脚本
问题描述
我正在编写一个程序来抓取以下网站:https ://filmstoon.in/
从中,我想找到几部电影(Batman Begins、Iron Man、Expendables 3)和电视剧(Game of Thrones)并刮取标题、主机 url 和元 url。我设法做到了,但是,它是为特定标题手动制作的。编码:
include ("simple_html_dom.php");
ini_set('max_execution_time', 0);
date_default_timezone_set('Europe/Vilnius');
$link = "https://filmstoon.in/series/game-of-thrones/";
$link1 = "https://filmstoon.in/batman-begins/";
$link2 = "https://filmstoon.in/iron-man/";
$link3 = "https://filmstoon.in/expendables-3/";
//TV Series
class episode{
private $title;
private $host_url;
private $linking_url;
public function setTitle($title){
$this->title = $title;
}
public function getTitle(){
return $this->title;
}
public function setHost_url($host_url){
$this->host_url = $host_url;
}
public function getHost_url(){
return $this->host_url;
}
public function setLinking_url($linking_url){
$this->linking_url = $linking_url;
}
public function getLinking_url(){
return $this->linking_url;
}
}
function main(){
$array_url = getting_url();
foreach($array_url as $single_link){
$episodeObject = info_from_linking($single_link);
echo_to_server($episodeObject->getLinking_url(), $episodeObject->getHost_url(), $episodeObject->getTitle());
writeToFile($episodeObject->getLinking_url(), $episodeObject->getHost_url(), $episodeObject->getTitle());
}
}
function getting_url(){
global $link;
$html = file_get_html($link);
$array_url = array();
foreach($html->find('.les-content a') as $divClass) {
$linking_url = $divClass->href;
array_push($array_url, $linking_url);
}
return $array_url;
}
function info_from_linking($episode_link){
$inside_linking = file_get_html($episode_link);
$mainDiv = $inside_linking->find('div[class="main-content main-detail"]')[0];
$title = $mainDiv->find('h3[itemprop="name"]',0)->plaintext;
$host_url = $mainDiv->find('iframe',1)->src;
$class = new episode;
$class->setTitle($title);
$class->setHost_url($host_url);
$class->setLinking_url($episode_link);
return $class;
}
function echo_to_server($linking_url, $host_url, $title){
$date = date('m/d/Y H:i', time());
echo "{$date} \t {$linking_url} \t {$host_url} \t {$title} \n";
}
function writeToFile($linking_url, $host_url, $title){
$date = date('m/d/Y H:i', time());
$result = array($date, $linking_url, $host_url, $title);
$output = 'scrape.txt';
file_put_contents($output, print_r($result, true), FILE_APPEND);
}
main();
//Movies
function get_content_movies($url){
$htmlContent = file_get_contents($url);
$dom = new simple_html_dom();
$dom->load($htmlContent);
if(count($dom->find('div[class="main-content main-detail"]'))>0){
$file = $dom->find('div[class="main-content main-detail"]')[0];
$title = $file->find('h3[itemprop="name"]',0)->plaintext;
$host_url = $file->find('iframe',1)->src;
$meta_link = $dom->find('meta[property="og:url"]',0)->content;
$date = date('m/d/Y H:i', time());
echo "{$date} \t {$host_url} \t {$meta_link} \t {$title} \n";
$result = array($title, $host_url, $meta_link, $date);
$output = 'scrape.txt';
file_put_contents($output, print_r($result, true), FILE_APPEND);
}
}
get_content_movies($link1);
get_content_movies($link2);
get_content_movies($link3);
一切正常,但是,如果我写的话,我想这样做:
php crawler.php batman begins
或在 cmd 中执行代码时的任何其他标题,它会专门找到该电影/电视剧并执行我编写的脚本。
到目前为止,我对如何执行此操作的唯一想法是抓取整个页面,将其存储在数据库中(例如 .txt 文件),然后使用 $argc 和 $argv 从中查找内容。或者 - 转到主页并使用搜索功能。我在命令行中编写的参数将传递给搜索表单,然后它将执行脚本。
但是,由于我是新手,所以我无法解决如何做这些想法。
解决方案
function getArgumentValues($argv, $seperator){
$values = "$argv[1]";
foreach($argv as $key=>$value){
if($key>1){
$values.="$seperator$value";
}
}
return $values;
}
function get_content_movies($linkMovies, $argv){
$htmlContent = file_get_contents($linkMovies);
$argvValue = getArgumentValues($argv, " ");
if(!preg_match("/href\=\"(.*?)\".*?oldtitle\=\"$argvValue/i", $htmlContent, $search)){
return null;
};
$key = array_values($search)[1];
$htmlContent = file_get_contents($key);
if(preg_match("/series/", $key)){
main();
}
else{
preg_match('/\<h3 itemprop\=\"name\"\>(.*)<\/h3>/iSU', $htmlContent, $title);
preg_match('/<iframe.*data-lazy-src=\"(.*)\".*><\/iframe>/iSU', $htmlContent, $embed_url);
preg_match('/<meta.*property="og:url".*content="(.*)".*\/>/iSU', $htmlContent, $meta_url);
$date = date('m/d/Y H:i', time());
echo "{$date} \t {$embed_url[1]} \t {$meta_url[1]} \t {$title[1]} \n";
$result = array($date, $embed_url[1], $meta_url[1], $title[1]);
$output = 'scrape.txt';
file_put_contents($output, print_r($result, true), FILE_APPEND);
}
}
get_content_movies($linkMovies, $argv);
推荐阅读
- java - Printing docx by Java
- mongoose - Mongoose fails to populate virtual when foreignField is an Array
- docker - Kompose 功能类似于 docker-compose links
- php - 在分形集合元数据中添加总和
- jsf-2 - 在 HttpSessionListener 中是否可以使用人脸上下文?
- ruby-on-rails - 如何确定 before_action 的调用者
- reactjs - 如何在 reactjs 中禁用 SelectTable 中的某些单选按钮?
- go - 如何使用 go 模块导入非 go 目录(例如:C src/)?
- javascript - Update array with add method in javascript
- r - Extracting tables from pdf in R