Open Source Intelligence Techniques: Resources for Searching and Analyzing Online Information

Book Preface

Sixth Edition
The previous (fifth) edition ofthis book was originally released in May of2016.1 assumed that it would be the final version, and stated in a few communication channels that it would be the last book I would write on the topic. In that book, I focused more on global techniques instead of specific resources in an attempt to get some extra mileage out of it Since the first edition was released in 2012,1 had been pushing out an updated version every year. The fifth edition seemed like the proper exit for the series. It was not because I was tired of online investigations. I may be more passionate now about collecting online evidence than I everwas before. I simplywanted to focus more energy toward other interests and opportunities, and I began spending a large amount ofmy time researching advanced privacy techniques.

In that down-time, I co-wrote The Complete Privacy & Security Desk Reference, and started a weekly podcast titled The Complete Privacy Security Podcast. I also launched a new company dedicated to assisting other people in disappearing completely when bad situations arose. Whether conducting online data-mining removals for privacy; facilitating property purchases through the use of anonymous land trusts and LLCs for asset protection; or complete relocations to safe houses in the middle of the night for protection, itwas a fascinating two years ofresearch and execution.

In late 2017, I had the itch to begin writing about online research methods again. Earlier that year, I co-created a Linux virtual machine targeted toward research professionals that included numerous utilities never mentioned in my previous books. This pre-configured operating system gained a lot ofpublic interest and we continue to update it twice yearly. Over the past two years, I updated my online research tools every month in order to continue to provide functional resources. I kept a running log of all of the changes that might need more explanation. In eariy 2018,1 started documenting all ofthis, plus some ofmy favorite new Linux tools, in written form with anticipation of creating a supplement to the fifth edition of this book. Within a couple of weeks, I realized that the entire book should be re-written and released as a new edition. I have always self-imposed a “rule” in reference to my book revisions. The potentialreleasemustinclude at least 25% brand new material, 25% updated content, and 25% untouched stable and beneficial techniques. I believe that this sixth edition meets this criteria.

Keeping a book up to date about ways to access information on the internet is a difficult task. Websites are constandy changing or disappearing, and the techniques for collecting all possible public information from them are affected. While the fifth edition of this book is still highly applicable, a lot has changed over the past two years. Much ofthis book contains new technique that were previously not available. The Facebook Graph search options continue to grow considerably. I have also created several new online search tools to help with the investigative process. While Twitter and Instagram took away a few features, there is an abundance of new techniques available to all of us. Finally, a surge of Python tools has bombarded us with new capabilities never available before. It is a very exciting time for internet investigations. The first chapter helps you properly configure your online investigation computer. It briefly discusses proper security protocols and free software. Great emphasis is placed on proper use of secureweb browsers. A major change since the previous editionwas the launch ofFirefox version 57. In this update, all legacy add-ons were eliminated. If the add-ons were not upgraded to Firefox’s new requirements, the tools no longer work. We lost some great resources, but this chapter will outline some new benefits.

A brand-new chapter explains the importance of virtual machines and instructs you on making your own or using a pre-configured option called Buscador. This virtual machine, co-created by David Westcott and myself, takes away the technical difficulties of installing custom Python applications, and leaves the user with a point-and-click environment ready for any type of investigation. Users of any skill level can now take advantage of Linux-based applications once restricted to those that understood programming and terminal prompts. With proper use ofthis system, you will no longer need to worry about viruses or malware. Dozens of applications, all included in Buscador, are explained in great detail in Chapter Two. The remaining chapters are structured a bit differently from previous editions. Instead of trying to combine related topics into a single chapter, such as “Telephone Numbers & Addresses” or “Domains & IP Addresses”, each category now has its own chapter. This allowed me to really delve into each topic and isolate the various techniques.

Fortunately, knowing methods for accessing data on one website often carries over nicely to otherwebsites. This entire sixth edition was accurate as ofFebruary 2018. If, or more likelywhen, you find techniques that no longer work, use the overall lessons from the entire book to push through the changes and locate your content. Once you develop an understanding of the data, you will be ready to adapt with it. As always, I will publish updates to my online blog and free newsletter.

I will also post new video tutorials for the members of my online training program. You can access all of this, including my current investigation tools and links, on my website located at IntelTechniques.com. More importantly, please consider joining my free online forum at that address. This is where you will hear about all of the amazing OSINT techniques and methods that are being discovered every day from some of the brightest minds in online research. There are currently over 4,000 registered users, some ofwhom are active daily. IllOpen Source Intelligence (OSINT)

Open Source Intelligence, often referred to as OSINT, can mean many things to many people. Officially, it is defined as any intelligence produced from publicly available information that is collected, exploited, and disseminated in a timely manner to an appropriate audience for the purpose of addressing a specific intelligence requirement For the CIA, it may mean information obtained from foreign news broadcasts. For an attorney, it may mean data obtained from official government documents that are available to the public. For most people, it is publicly available content obtained from the internet.

What is this book?

Overall, this book includes several hundred sources of free and open data which could identify personal information about anyone. All of the resources are 100% free and open to the public. Each resource is explained, and any creative search techniques involving the resource are detailed. When applicable, actual case examples are provided to demonstrate the possibilities within the methods. The book can be read in any order and referenced when a specific need arises. It is a guidebook oftechniques that I have found successful in my investigations. Locating this free online information is not the final step of OSINT analysis. Appropriate collection methods will be detailed and referenced. Whether the data you obtain is for an investigation, a background check, or identifying problem employees, you must document all of your findings. You cannot rely on the information being available online forever. A website may shut down or the data may be removed. You must preserve anything ofinterest when you find it. The free software solutions presented here will help you with that.

OSINT search techniques do not apply only to websites. There are many free programs that automate the search and collection of data. These programs, as well as appEcation programming interfaces, will be explained to assist the advanced investigator ofopen source intelligence. In summary, this book is to serve as a reference guide to assist you with conducting more accurate and efficient searches of open source intelligence.