a rough written "guide" compiled from years of ADHD brain notes - enjoy
Repo tegridydev/python-OSINT-notebook, read from GitHub 7 h ago. tegridydev has not joined Take My Repo.
tegridydev/python-OSINT-notebook is a public repo on GitHub by tegridydev. a rough written "guide" compiled from years of ADHD brain notes - enjoy. It declares the MIT license on GitHub. It is written mainly in JavaScript, has 142 stars and last changed on 2025-04-29. Nobody has reviewed it on Take My Repo yet, which says nothing about its quality. Read from GitHub on 2026-11-19.
In the maintainer's words. Shown from GitHub; Take My Repo does not keep a copy.
Open-Source Intelligence (OSINT) is about collecting and interpreting publicly available data from websites, social networks, and other internet-connected resources. Python remains popular for OSINT thanks to its large ecosystem and active open-source community.
I've tried my best to make this python-OSINT-notebook up to date and relevant for (2025), it compiles a bunch of my ADHD brain OSINT notes and streamlined some examples, focusing on python open-source tools, libraries, and techniques for anyone interested in gathering and analyzing public data.
WhatIsIt?: This current version of my python-OSINT-notebook covers:
Not everything is 100% this is a WIP rough guide so always double check and verify stuff before you install/run it (youalreadydothatyeah?) <3
SpiderFoot – GitHub - smicallef/spiderfoot - OSINT Automation Platform. SpiderFoot is a multi-module OSINT tool that scans various data sources (DNS, IP addresses, domain details, social media, dark web sites, etc.). It offers both a web-based interface and a CLI. The open-source version (v4.x) supports at least 200 modules and can export data in multiple formats (CSV, JSON, and others). SpiderFoot is under the MIT license and remains popular for mapping and correlating information about a target, such as a domain or an email address.
Recon-ng – GitHub - lanmaster53/recon-ng - Modular Reconnaissance Framework. Recon-ng is a Python-based framework with a console interface inspired by Metasploit. It includes a marketplace of modules for collecting details about domains, IP ranges, people, and more. Many modules rely on API keys for services like Shodan, Bing, or GitHub. Recon-ng organizes collected info in a database and lets you export final results in a variety of formats.
DataSploit – GitHub - datasploit/datasploit - Automated OSINT Framework. DataSploit focuses on automating recon tasks for various targets—domains, emails, phone numbers, etc.—to gather data from multiple sources. It can generate HTML or JSON reports. Its development slowed in recent years, so if you’re interested, check for updated forks or community-maintained versions. The framework’s main value is its ability to do one-stop OSINT across multiple data points.
OSRFramework – - Open Sources Research. OSRFramework includes several Python tools (usufy.py, mailfy.py, searchfy.py) that check usernames on popular sites, search for email address usage, or do DNS lookups. It also includes a console tool. It’s installable via pip, and each sub-tool can be run independently or used as part of a workflow.
theHarvester – GitHub - laramies/theHarvester - Search Aggregation for Domains. theHarvester queries search engines (Google, Bing, DuckDuckGo, etc.) and other databases (PGP key servers, DNS) to find emails, subdomains, and hosts linked to a target domain. It’s included in Kali Linux and can be installed via pip. It’s often used early in a domain recon process to see what quick results come up from public sources.
Metagoofil – Metadata Extraction from Public Files. Metagoofil searches for publicly accessible documents related to a domain (PDF, DOCX, PPT) and downloads them to extract metadata such as creator names or software versions. Although it’s an older tool, the concept of scanning for metadata remains relevant for OSINT. In practice, you can replicate some of its behavior with Python libraries like pypdf or ExifTool wrappers.
Sublist3r – GitHub - aboul3la/Sublist3r & DNS Recon – Subdomain Enumeration. Sublist3r enumerates subdomains by checking various search engines and DNS queries, while dnsrecon performs DNS lookups, zone transfers, and more. They’re both Python-based and commonly used in the reconnaissance phase to map out an organization’s subdomains.
Shodan (Python Library) – PyPI - shodan - Internet-Device Search. Shodan is a search engine that scans the internet for open ports and device banners. Its official Python library offers an easy interface for the Shodan API. You can query by hostname, IP, or service and retrieve detailed port, banner, and vulnerability data without doing direct scanning yourself.
Censys (Python Library) – PyPI - censys - Internet Assets Search. Censys is another internet-wide scanning platform with a Python library that provides structured data on IPv4 hosts, certificates, and domains. It supports more in-depth queries on SSL certificates and has an API similar in concept to Shodan’s. Both services require an API key to do anything beyond the free tier.
Sherlock – GitHub - sherlock-project/sherlock - Find Usernames Across Platforms. Sherlock checks whether a given username exists on hundreds of social media sites and other platforms. It doesn’t rely on official APIs for most sites but instead checks URLs or account pages. The result is a list of confirmed or unconfirmed accounts, which helps you map a person’s online presence.
Social Analyzer – GitHub - qeeqbox/social-analyzer - Profiles & Intelligence Aggregator. Social Analyzer searches up to 1000+ platforms by username, email, phone, or full name. It also has modules that try to confirm whether a discovered profile truly belongs to the target. It can be run as a CLI, library, or through a web interface (with Docker support), making it handy for large-scale persona investigations.
Holehe – GitHub - megadose/holehe - Email to Registered Accounts. Holehe checks if an email address is registered on about 120 platforms by automating the “forgot password” function, which often reveals if an account exists. This method is passive in the sense that it doesn’t send reset links to the email owner but relies on the site’s response. Holehe can be run from the command line or integrated into a Python script (using async calls).
Snscrape – GitHub - JustAnotherArchivist/snscrape - Social Network Scraping. Snscrape collects posts and user data from platforms like Twitter (X), Reddit, Instagram, Telegram channels, and so on, often without official API keys. It can be used as a CLI tool or a Python library to gather recent or historical posts. Because it scrapes publicly available data, it’s a good alternative when an official API is unavailable or limited.
Instaloader – GitHub - instaloader/instaloader - Instagram Media & Metadata. Instaloader is a Python package that retrieves posts, metadata, and stories from public or (with login) private Instagram accounts you follow. You can use it to download images, captions, and other profile data for OSINT research.
Maltego Transforms in Python Maltego is a graphical OSINT tool (proprietary but with a community edition) that uses “transforms” to pull data from various sources. These transforms can be written in Python, allowing developers to integrate custom data feeds or specialized logic into Maltego’s graph-based interface.
MISP / OpenCTI These threat intelligence platforms provide APIs and Python libraries (like PyMISP) to store and share OSINT findings in a structured format. They let security teams collaborate, correlate threat indicators, and enrich data with community-fed intelligence. While not purely OSINT tools, they can serve as repositories for discovered indicators.
Dark Web Monitoring OSINT can involve scanning onion sites for mentions of a target or checking for leaked data in underground forums. Python scripts can use the Tor network via libraries like Stem, or specialized platforms like OnionScan (though OnionScan itself is in Go) to gather info. It typically requires custom code to handle captcha or forum logins.
This section explains how to install and configure Python-based OSINT tools on Linux, Windows, macOS, and Docker. It also touches on setting up API keys and verifying your setup.
venv (or using Anaconda) avoids library conflicts.requests, beautifulsoup4, or dns.resolver. If installing from requirements.txt, dependencies usually get installed automatically. Tools like snscrape might need system libraries (e.g., libxml2-dev on Linux) for lxml.theHarvester, recon-ng, or SpiderFoot might be pre-installed or installable via apt.pip install recon-ng (then recon-ng from CLI).
- git clone https://github.com/smicallef/spiderfoot.git && pip install -r requirements.txt (run python sf.py).nmap, whatweb), also install those from your package manager.docker run -p 5001:5001 smicallef/spiderfoot runs SpiderFoot in a container, exposing its web UI at localhost:5001.--tor in Sherlock).In this section, we walk through typical ways to run these OSINT tools, plus Python snippets for more advanced usage or automation.
theHarvester example:
bash theHarvester -d example.com -l 100 -b bing
Collects up to 100 results from Bing for any mention of example.com, returning emails and subdomains.
Recon-ng example:
1. workspaces create test1
2. add domains example.com
3. marketplace install hackertarget
4. load recon/domains-hosts/hackertarget
5. run
6. show hosts
SpiderFoot example:
bash # Web UI: python sf.py -l 127.0.0.1:5001 # Then open [http://127.0.0.1:5001](http://127.0.0.1:5001) and set up a scan
You can also run headless scans via CLI scripts (sfcli.py).
Sherlock example:
bash sherlock alicebob --timeout 5 --csv
Outputs discovered accounts to a CSV file.
Holehe example:
bash holehe target@example.com
Checks if target@example.com is registered on known platforms.
Shodan API:
import shodan api = shodan.Shodan("YOUR_API_KEY") results = api.search("net:198.51.100.0/24") for match in results["matches"]: print(match["ip_str"], match.get("ports", []))
Censys API:
from censys.search import CensysCertificates cc = CensysCertificates() query = "example.com AND parsed.names: example.com" results = cc.search(query) for cert in results: print(cert.get("parsed.names"))
Using Sherlock in a Python Script (subprocess approach):
import subprocess, csv res = subprocess.run(["sherlock", "--csv", "johnsmith"], capture_output=True, text=True) lines = res.stdout.splitlines() for row in csv.reader(lines): if row[2].lower() == "exists": print(f"Found username on {row[0]}: {row[1]}")
Here’s a quick example that retrieves subdomains from crt.sh and then checks them with Shodan:
import requests import shodan domain = "example.com" res = requests.get(f"[https://crt.sh/?q=%25](https://crt.sh/?q=%25){domain}&output=json") subdomains = set() for entry in res.json(): names = entry["name_value"].split("\n") for name in names: if name.endswith(domain): subdomains.add(name) api = shodan.Shodan("YOUR_KEY") for sub in list(subdomains)[:10]: # Resolve subdomain to IP: dns_info = requests.get(f"[https://dns.google/resolve?name=](https://dns.google/resolve?name=){sub}&type=A").json() if "Answer" in dns_info: ip = dns_info["Answer"][0]["data"] try: info = api.host(ip) print(sub, ip, info.get("ports")) except shodan.APIError: pass
Tools like pandas or NetworkX can help store or visualize OSINT results. For geolocation data, Folium can generate maps.
Example with NetworkX:
import networkx as nx G = nx.Graph() person = "John Doe" accounts = ["twitter/johndoe", "github/johndoe123"] G.add_node(person, type="person") for acc in accounts: G.add_node(acc, type="account") G.add_edge(person, acc) nx.write_graphml(G, "output.graphml")
tegridydev/python-OSINT-notebook is a public repo on GitHub by tegridydev. a rough written "guide" compiled from years of ADHD brain notes - enjoy.
It declares the MIT license on GitHub.
Its maker has not tagged a system, so it is unknown here. Its README says what it needs.
Open "Take it" on its page: Take My Repo writes an install plan for your machine and hands it to your AI agent (Claude Code, Codex or Cursor), which asks you before each step. Take My Repo has not tested it on any machine.
Its last change on GitHub was on 2025-04-29. Take My Repo does not judge from that whether it is maintained.
Nobody has reviewed it on Take My Repo yet, which says nothing about its quality.
🔥 Find the latest breaking Vue3、Vue CLI 3+ & Vite News. (2024/2025)
Hunt down social media accounts by username across social networks
Decrypt and export passwords, cookies, history and more from 20 browsers on Windows, macOS and Linux. For authorized security research, incident response and DFIR.
Bring projects, wikis, and teams together with AI. AppFlowy is the AI collaborative workspace where you achieve more without losing control of your data. The leading open source Notion alternative.

Graphs that teach > graphs that impress. Turn any code into an interactive knowledge graph you can explore, search, and ask questions about. Works with Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more.
All logos of teams in the top 25 European (UEFA) leagues. Seasons 2021/22 to 2026/27.
Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files

MVP of an idea using multiple local LLM models to simulate and play D&D
Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts
This project is a multi-agent security framework that utilizes multiple LLM models to analyze and generate comprehensive security briefs.
Open-MalSec is an open-source dataset curated for cybersecurity research and application
xanadu-2 is a modernized revision of Ted Nelson's classic Project Xanadu
This page is also available as structured data, with the same sources and dates.
/api/v1/resources/gh/tegridydev/python-OSINT-notebookTake My Repo has not tested this on your machine. Requirements come from the project's own documentation.