You are here: American University School of International Service Centers Security, Innovation, and New Technology The Data Revolution: OSINT's Role in the Digital Age

Technology

The Data Revolution: OSINT's Role in the Digital Age

By  | 

Open-source information is publicly accessible material that can be lawfully acquired through requests, purchases, or observations. When this information is gathered, analyzed, and disseminated to a specific audience, open-source information transforms into open-source intelligence (OSINT). While conventional wisdom previously limited OSINT's value to complementing classified intelligence, the ongoing technological revolution has significantly expanded the scope and applicability of OSINT. From aiding the intelligence community to forecasting market risks, OSINT now empowers a wide range of public and private sector actors. 

The OSINT Cycle

Open-source information becomes OSINT after data goes through the intelligence cycle, which encompasses four essential components, collection, processing, analysis, and production. For example, the presence of a cargo plane delivering humanitarian aid to a conflict zone. This plane would constitute a raw data point until it fulfills specific information requirements, such as identifying the plane's ownership, its military or civilian nature, and the presence of a flight pattern between the conflict zone and the plane's origin. This process is what gives meaning to data.

The initial phase of the OSINT intelligence cycle pertains to data collection from open sources. OSIF encompasses four main categories: widely available data, targeted commercial data, individual experts, and grey literature. Widely available data includes information disseminated by newspapers, radio, television networks, and academic papers, among other publicly accessible sources. This category also includes government records, press releases, and public survey data. Targeted commercial data includes resources such as satellite imagery, customized datasets, market surveys, and harvested metadata. Individual experts refer to subject matter specialists who provide expertise relevant to the specific information needs of an OSINT analyst. Grey literature takes a more nuanced approach, including data published outside conventional channels, such as policy literature, white papers, speeches, and unclassified government documents. Data collection methods can be active, or passive based on the level of interaction with the information sources.

The next stage of the OSINT cycle requires the collected data to undergo processing and analysis before being disseminated as the final product. This stage involves refining the gathered data by removing unwanted elements and translating and aggregating crucial information to enhance its usability for further manipulation. The analysis stage of the OSINT cycle exploits the processed data to separate “good” and “bad” intelligence with the aim of increasing the reliability of the gathered intelligence. This is the most critical stage of the OSINT cycle because it includes verifying the authenticity of the processed intelligence. The outcome of this process will be added to the final product; hence it is important for the processed information to be verified, evaluated, and contextualized.

Once the raw data is collected, processed, and analyzed, it is ready for the final stage of the OSINT cycle, production. The primary objective of the final intelligence product is to offer analytical conclusions to a client, and its format may vary in accordance with the client's specific requirements, ranging from visual briefings to written reports. In instances where OSINT findings relate to classified intelligence needs, these products may be classified by the IC.

Why OSINT? 

In recent years, the applications of OSINT have expanded and diversified significantly. OSINT complements traditional intelligence methods like Human Intelligence (HUMINT) and Signal Intelligence (SIGINT) while simultaneously broadening the net utility of an organization. Although SIGINT, HUMINT, and other traditional intelligence-gathering methods involve high costs and serious risks to human lives, OSINT provides a far more cost-effective and safer solution. It harnesses tools such as data mining, satellite imagery analysis, and geodata identification, both freely available and commercially accessible. OSINT's real-time data access enhances the timeliness of intelligence processes, allowing analysts and organizations to stay ahead of emerging technological trends and current events.

In recent times, governments have recognized OSINT's extensive potential and integrated various applications into crisis management. In the ongoing Russo-Ukrainian conflict, OSINT has influenced modern warfare by involving civilians in the targeting process, leveraging the widespread use of smartphones to extract intelligence from social media, and through partnering with private companies to use low-orbital satellites for tracking Russian movements across the frontline. OSINT has also further expanded the application of the tradecraft by allowing private companies to gather valuable insights into a target market. OSINT's reach spans beyond state actors, as corporations also utilize its capabilities to assess industry trends. By analyzing data from market surveys, customer rankings, risk assessments, and K-10 forms, businesses can fine-tune their strategies to meet specific market demands and gain a competitive edge in their respective industries. In addition OSINT also facilitates the exploration of nontraditional subjects, including implications of climate change, energy usage, environmental security, and issues related to organized crime.

While OSINT has revolutionized how we manipulate information, it doesn’t come without its challenges. OSINT highlighted the challenges states face in controlling information, leading to increased empowerment for civilians, non-profits, and small enterprises. Academics, research organizations, and investigative journalists have made significant strides in using OSINT tools. For example, journalists and independent OSINT analysts frequently employ advanced OSINT tools for digital forensics to verify data and debunk misinformation. In 2018, a team of OSINT analysts used passive intelligence methods to geolocate the execution sites of the Islamic State (ISIS) by analyzing their propaganda videos.

Open Questions about Open Sources

OSINT applications have expanded beyond traditional intelligence sectors to encompass an array of fields, including journalism, business, and academia. As technology continues its rapid evolution, OSINT's role is poised to become even more influential. Between the proliferation of data in our digital age, and the integration of emerging technologies, particularly Artificial Intelligence (AI), there’s no denying that these new technologies are set to redefine the OSINT landscape. However, this evolution also raises critical questions about the ethical use of OSINT, and the need for robust privacy safeguards. With increased access to information, the potential for misuse is a growing international concern. Striking a balance between open-source transparency and protecting individuals' rights is already a challenge that OSINT practitioners and policymakers must address. In conclusion, as AI becomes increasingly intertwined with OSINT, ensuring the accuracy, credibility, and accountability of automated data collection and analysis processes will be imperative.

About the Author

Siddhant Kishore is a second-year graduate student in the School of International Service's Global Governance, Politics, and Security Program, specializing in global security. Siddhant is an Intelligence Analyst intern at the Institute for the Study of War (ISW). Before joining SIS, Siddhant worked in the private sector and regional non-profit organizations in India and Afghanistan.