id
name
processing priority
3
site type
0 (generic, awaiting analysis)
review version
11
html import
20 (imported)
first seen date
2024-03-02 12:47:48
expired found date
-
created at
2024-06-10 07:40:11
updated at
2026-01-04 02:40:28
length
14
crc
52556
tld
2860
nm parts
0
nm random digits
0
nm rare letters
0
is subdomain of id
-
previous id
0
replaced with id
0
related id
-
dns primary id
dns alternative id
0
lifecycle status
0 (unclassified, or currently active)
deleted subdomains
0
page imported products
0
page imported random
0
page imported parking
0
count skipped due to recent timeouts on the same server IP
0
count content received but rejected due to 11-799
0
count dns errors
0
count cert errors
0
count timeouts
0
count http 429
0
count http 404
0
count http 403
0
count http 5xx
0
next operation date
-
server bits
—
server ip
-
mp import status
20
mp rejected date
-
mp saved date
-
mp size orig
33884
mp size raw text
4987
mp inner links count
11
mp inner links status
20 (imported)
title
crwlr.software - Open Source PHP Library for Crawler and Scraper Development
description
crwlr is a collection of open source PHP composer packages that provide the necessary tools to build web crawlers and scrapers.
site name
author
Christian Olear
updated
2025-12-22 14:36:03
raw text
Crwlr - Open Source PHP Library for Crawler and Scraper Development Packages Blog Contact PHP Composer Packages for Crawler and Scraper Development crwlr.software is a collection of open source PHP composer packages that provide the necessary tools to build web crawlers and scrapers. The crawler package contains everything and helps you build crawlers as fast as possible. There are also sub-packages that you can use standalone. Get started now! you@computer:~/Projects/MyCrawler Packages crwlr / crawler The main package of this collection, providing kind of a framework and a lot of ready to use, so-called steps, that you can use to build your own web crawlers and scrapers with. docs (v1.5) source crwlr / url The Swiss Army knife for urls. Parses urls to components (scheme, host, domain, path,...). You can access and modify u...
redirect type
0 (-)
block type
0 (no issues)
detected language
1 (English)
category id
index version
2025123101
spam phrases
0
text nonlatin
0
text cyrillic
0
text characters
3500
text words
747
text unique words
293
text lines
95
text sentences
36
text paragraphs
17
text words per sentence
20
text matched phrases
1
text matched dictionaries
2
links self subdomains
0
links other subdomains
0
links other domains
0
links spam adult
0
links spam random
0
links spam expired
0
links ext activities
0
links ext ecommerce
0
links ext finance
0
links ext crypto
0
links ext booking
0
links ext news
0
links ext leaks
0
links ext ugc
8 - twitter.com
links ext klim
0
links ext generic
0
dol status
0
dol updated
2025-12-22 14:36:03
rss path
rss status
1 (priority 1 already searched, no matches found)
rss found date
-
rss size orig
0
rss items
0
rss spam phrases
0
rss detected language
0 (awaiting analysis)
inbefore feed id
-
inbefore status
0 (new)
sitemap path
sitemap status
30 (processing completed, results pushed to table crawler_sitemaps.ext_domain_sitemap_lists)
sitemap review version
1
sitemap urls count
498
sitemap urls adult
0
sitemap filtered products
0
sitemap filtered videos
0
sitemap found date
2024-03-06 06:57:00
sitemap process date
2024-10-04 21:44:47
sitemap first import date
-
sitemap last import date
-