intelmq.bots.collectors.http package

Submodules

intelmq.bots.collectors.http.collector_http module

HTTP collector bot

Parameters: http_url: string http_header: dictionary

default: {}

http_verify_cert: boolean

default: True

extract_files: value used to extract files from downloaded compressed file

default: None all: True; some: string with file names separated by ,

http_url_formatting: bool|json to turn on time formatting (and to specify delta to current time) http_username, http_password: string http_proxy, https_proxy: string http_timeout_sec: tuple of two floats or float http_timeout_max_tries: an integer depicting how often a connection attempt is retried verify_pgp_signatures: whether to download and check file signatures

default: False

signature_url: string signature_url_formatting: the same as http_url_formatting gpg_keyring: none (defaults to user’s GPG keyring) or string (path to keyring file)

intelmq.bots.collectors.http.collector_http.BOT

alias of intelmq.bots.collectors.http.collector_http.HTTPCollectorBot

class intelmq.bots.collectors.http.collector_http.HTTPCollectorBot(bot_id: str, start: bool = False, sighup_event=None, disable_multithreading: Optional[bool] = None)

Bases: intelmq.lib.bot.CollectorBot, intelmq.lib.mixins.http.HttpMixin

Fetch reports from an URL

extract_files: bool = False
format_url(url: str, formatting) str
gpg_keyring: str = None
http_password: str = None
http_url: str = '<insert url of feed>'
http_url_formatting: bool = False
http_username: str = None
init()
process()
rate_limit: int = 3600
signature_url: str = None
signature_url_formatting: bool = False
ssl_client_certificate: str = None
verify_pgp_signatures: bool = False
verify_signature(data: bytes)

Download signature file and verify the report data.

class intelmq.bots.collectors.http.collector_http.Time(delta=None)

Bases: object

__init__(delta=None)

Delta is a datetime.timedelta JSON string, ex: ‘{“days”=-1}’.

intelmq.bots.collectors.http.collector_http_stream module

HTTP collector bot

Parameters: http_url: string http_header: dictionary

default: {}

http_verify_cert: boolean

default: True

http_username, http_password: string http_proxy, https_proxy: string strip_lines: boolean http_timeout_sec: tuple of two floats or float

intelmq.bots.collectors.http.collector_http_stream.BOT

alias of intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot

class intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot(bot_id: str, start: bool = False, sighup_event=None, disable_multithreading: Optional[bool] = None)

Bases: intelmq.lib.bot.CollectorBot, intelmq.lib.mixins.http.HttpMixin

Open a streaming connection to the URL and process data per line

http_password: str = None
http_url: str = '<insert url of feed>'
http_username: str = None
init()
process()
rate_limit: int = 3600
ssl_client_certificate: str = None
strip_lines: bool = True

Module contents