no any result !

[iq-rasco]

[RevoltSecurities]

Hi @iq-rasco ,
please run again with --verbose enabled to see whats the main issue
and please get back to us with the ouput.

Kind regards,
@RevoltSecurities

[iq-rasco]

hey @RevoltSecurities

spideyx crawler -site https://hackerone.com --verbose

         _      _              __   __
        (_)    | |             \ \ / /

___ _ __ _ | | ___ _ _ \ V /
/ || ' \ | | / ` | / _ | | | | > <
_ | |) || || (| || /| || | / . \
|/| ./ || _,_| __| _, |// _
| | / |
|| |/

                 @RevoltSecurities

[version]: spideyx current version v1.0.0 (latest)
[INFO]: started active crawling 🕸 ==> https://hackerone.com
Exception at active crawler scraper: Couldn't find a tree builder with the features you requested: lxml. Do you need to install a parser library?, <class 'bs4.FeatureNotFound'>

[iq-rasco]

I think the problem is because the site https://wayback.archive.org/ is down

[RevoltSecurities]

Hello @iq-rasco ,
Thanks for the images, try to update your Python version to 3.11.+ and if its upto date then install and upgrade the existing package using this commands:

pip install -U lxml
pip install -U bs4
pip install -U beautifulsoup

Try to update these packages and this is caused by some missing packages not web archive. Try to get back us if you still face the issue.

Kind regards,
@RevoltSecurities

[TrffnSec]

Still Not Working!

That's it, No Results! 🤧

[RevoltSecurities]

Hi @TrffnSec ,
Could you try to enable options -ar and --verbose and run spideyx, so it helps what actual problem is there.

Kind regards,
@RevoltSecurities

[Eytes]

Greetings! When I run it in a docker container in python:3.12-alpine3.20. When I turn on the -em option, there is no perfect output

[RevoltSecurities]

Hi @Eytes ,
We request you to provide full image with the command you used and also you can redact the host and attach the full image so we can see what is the main issue with spideyx

Kind regards,
@RevoltSecurities

[Eytes]

@RevoltSecurities

[RevoltSecurities]

Hi @Eytes ,
Thanks for providing the full images and based on the provided image the command -em should be used like:

spideyx crawler -site https://yoursite.com -em .png,.css,.js

but in your actual command is -em png but it should be -em .png .

Kind regards,
@Eytes

[Eytes]

@RevoltSecurities
The advice also didn't help, although I put a period before the file extension.

[RevoltSecurities]

Hi @Eytes ,
we have verified the same target you passed and problem is the first dept crawling there isn't any result with png extension or js extension , but to verify the workflow of -em of spideyx , you can use -em .json to verify that spideyx -em is working.

Kind regards,
@RevoltSecurities

[RevoltSecurities]

Hi @Eytes ,
we have verified the same target you passed and problem is the first dept crawling there isn't any result with png extension or js extension , but to verify the workflow of -em of spideyx , you can use -em .json to verify that spideyx -em is working.

Kind regards,
@RevoltSecurities

[Eytes]

Hi, @RevoltSecurities

I ran the same scan as before. Yes, one path was found. But it can't be that there are no requests to css files. Or there was not a single html file

[RevoltSecurities]

Hi @Eytes ,
I can understand what you are explaining but I also suggest that before if you are testing the -em feature of spideyx, just crawl with dept 1 and check the output and if there is a png extension and when using spideyx with -em .png then you can verify thats a issue or not in spideyx.

Kind regards,
@RevoltSecurities