WP Content Crawler WordPress Crawler Plugin v1.15.0

WP Content Crawler WordPress Crawler allows you to automatically publish content from nearly any website to your website, blog, or online store on WordPress! Once you set your preferences, the plugin will automatically find the website URL and scan it in the background.

Detailed toolbar – See what’s happening in the background: active pages, number of messages viewed, number of messages updated, messages viewed and last updated, last added URL, CRON events started, messages and URLs now saved…

Demo: https://codecanyon.net/search/15983018

Features WP Content Crawler – Automatically scrape content from almost any website

• Save all article details
• Visual Inspector
• Crawl (fetch, fetch, save) posts
• Recrawl (update) posts
• Delete posts
• Schedule Control
• Save categories
• Save slugs (permalinks)
• Save taxonomies
• Save posts to custom categories
• Customize post meta
• Content templates
• Alternative selectors
• Find and replace anything
• Page posts
• Post list
• Remove unnecessary elements
• Automatically insert site category URLs
• Remove links from posts
• Password protection
• Quickly check everything
• Check all your site’s settings at once
• Customizable global settings for each site
• Save all images in post content
• Save images as a gallery
• Any data as a shortcode
• Proxy
• Cookies
• Crawl as many posts as possible
• Email notifications
• Get data from JSON
• Advanced HTML manipulation
• Automatic translation
• Automatic content rotation
• Check for duplicate posts
• Schedule posts
• Save WooCommerce products
• Save alt and other title attributes…

Recommended: WordPress front-end dashboard plug-in WP Frontend Admin Premium

Changelog WP Content Crawler – automatically get content from the website

= v1.11.0 - 11 March 2021 =
New
Filters. With filters, you can do things conditionally, i.e. you can say “if this happens, then do this”, where the condition part is optional. The filters have 30 Condition Commands and 25 Action Commands. Via the filters’ Action Commands, these are possible:
Make a text uppercase, lowercase, title case, snake case, kebab case, camel case, studly case, slug, and make its first letter uppercase
Find and replace in a text, such as post title or product attribute value
Clear a text. For example, you can clear a tag’s text to remove it if a certain condition is met.
Limit the number of characters and words in a text or HTML code
Remove empty HTML elements in a text
Remove links targeting specific domains or not targeting specific domains in a text or element
Add something before or after a text
Remove an element from the source code retrieved from the target site
Clone an element
Calculate the numeric values. For example, you can change the price of a product depending on a condition.
Stop crawling a post and delete it from your site if a certain condition is met. For example, you delete the post if the post is not found in the target site when recrawling. Another example is to delete a post if the title or content has a specific word that you do not want in your site.
Set author of the post depending on a condition. For example, you can change the author of the post if the post has a specific category.
Set post status, Add tags, Add categories
Send email notifications. For example, if a condition is satisfied, you can change the post status to pending review and send an email notification to yourself so that you can review and publish it.
Improvement
Import/export Cookies. You can copy the cookie header from the network tab of the developer tools of your browser and import it. See Importing all cookies for more information.
Post Status option contains all the post statuses registered to WordPress.
Options Box opens much faster
Error message displayed when a setting is not configured as expected now displays the path to problematic setting so that you can understand which setting has to be fixed.
Fix
Test results of a setting that has a File Options Box should not modify the result if the options box does not have any options configured.
WooCommerce options are shown in multi-site installations as well
wpcc/post/source-code/after_retrieve action is not triggered when crawling a category page. Instead, wpcc/category/source-code/after_retrieve action is triggered.
Other
Tested and works with WordPress 5.7, 5.6, 5.5, 5.4, 5.3, 5.2, 5.1, 5.0, 4.9, with PHP 8.0, 7.4, 7.3, 7.2, with Chrome, Firefox, Opera, with WooCommerce 5.1, 5.0, 4.9, 4.8, 4.7, 4.6, 4.5, 4.4, 4.3, 4.2, 4.1, 4.0, 3.9, 3.8, 3.6, 3.3.
Minor fixes and improvements

= v1.10.1 – 25 August 2020 =
### Fix
– Make it compatible with the major changes made in WordPress 5.5. WordPress 5.5 does not include jQuery Migrate, which lets deprecated jQuery functions be used for backward compatibility. This caused the plugin’s some JavaScript features to not work properly. This version removes the usage of any deprecated jQuery functions. Additionally, as instructed by WordPress’s official Test jQuery Updates plugin, the plugin has been thoroughly tested with all of the 4 specified combinations of jQuery, jQuery Migrate, and jQuery UI. This means that the plugin should now be compatible as well with the jQuery changes that will be made in the future WordPress versions.
– Abandon the usage of PHP features deprecated in PHP 7.4.
– Tooltip must not block the underlying UI elements even if it is not visible.
### Other
– Tested and works with WordPress 5.5, 5.4, 5.3, 5.2, 5.1, 5.0, 4.9, with PHP 7.4, 7.3, 7.2, with Chrome, Firefox, Opera, with WooCommerce 4.4, 4.3, 4.2, 4.1, 4.0, 3.9, 3.8, 3.7, 3.6, 3.5.

⭐Similar suggestion: Collection of plugins for automatically crawling WordPress website content

Activate WP Content Crawler when it says expired or locked

• Method 1: Uninstall the plugin and reinstall it. Go to Settings -> Content Crawler License Settings and enter any data to activate the plugin key. -> Works normally again.
• Method 2 Go to the plugin path wp-content-crawler\app\WPTSLMClient.php
  • Find the private function handleAPIResponseForInfo(&$response) {…}
  • Replace the code inside {…} with the following:

$this->resetTrialCount();
$this->setValid(‘1’);
$this->setErrorMessage(null);
return true;

(The above code is included in the download by default, but in some cases, you can restore it to the original code when installing the plugin for the first time)

The result is as follows:

Download WP Content Crawler v1.15.0 

Note: You may need to unzip the plugin before installing it. We offer no guarantees if any theme/plugin contains viruses. Please check Virustotal before using on localhost.