Passive Reconnaissance Website Analysis

Passive reconnaissance mission Website AnalysisAssignment Reconnaissance PaperStudent Name Soumil DeshpandeExecutive SummaryIn this assignment, passive reconnaissance mission was comeed on The Weather Channels meshworksite i.e. www.weather.com and important results have been obtained regarding the faces online behavior. In this passive reconnaissance attack we have discovered on the whole the airfield name and the corresponding IP addresses of the hosts, domain names, servers, rustle DNS, the webhost name and the location of the server. Further more, we have in desire manner discovered and analyzed many files such(prenominal) as .doc, .pdf, .xls from online humanity sources which in return gave us valuable learning about the establishment such as the rehearsername of few employees who have created those files, the softw ar that was used to create those files, reckon of creation, date of edit, what server it was uploaded to, the operating system in use etc. It also pro vided us with the folder paths where the files were preset on the host servers. This information is genuinely valuable to an attacker who is performing a reconnaissance attack as it gives out a lot of critical information about the internet step of the organization and this data was easily available to the attacker via all public sources using passive reconnaissance. To avoid this, we must make authentic that we keep a track of all the public information which is readily available on the internet such as DNS lookups, WHOIS information and all the public files hosted and make sure that no valuable information dope be extracted by an attacker which in turn could prove harmful for the organization if an attack was demanded on the organization in the future.Introduction to the organizationThe Weather Channel is an Ameri fundament cable and send television channel by NBC Universal. It is also a desktop, mobile app and satellite radio channel. Headquarters of the friendship is loca ted in Atlanta, Georgia. This organization mainly provides weather related news and psychoanalysis which include 24-hour weather forecast and microwave radar imagery.This company was chosen by me for this assignment because this company has a global presence and a very well wide spread and retrievable online footprint. It has servers all around the world which would give me many different points of opportunities for reconnaissance. And as their main function is far away from security I would assume that not a very high level of resources is spent on information security of all the online assists, domains, hosts and websites.Tools and Methods used to obtain data for passive reconnaissanceFollowing be the tools used for conducting passive reconnaissance with the explanation of their working FOCA (Fingerprint Organizations with Collected Archives) (FOCA n.d.)FOCA is an easy to use GUI tool made for windows whose main purpose is to extract metadata from the ac customsed website. FOC A automates the process of finding and downloading all the public documents of various format from the website, analyzing them and presenting the analyzed information in a human readable format on the FOCA windows GUI.The documents which are downloaded from the organizations website are seemed by various methods including expect engines like Google, Bing, Exalead etc.We can also add local files which we have acquired from other processes in the FOCA GUI for analysis and metadata extraction. An impressive feature of FOCA is that we can analyze the URL and the file without even downloading it.FOCA is capable of downloading and analyzing various types of documents ranging from Microsoft Office files to uncommon adobe files or other custom formats.After all the metadata is extracted from the files, FOCA breakes similar information like documents created by the same group, Usernames of the owners of the documents and can even create a communicate map based on the metadata that was an alyzed from all the public sources available on the internet.FOCA also includes a server discovery mode which automatically searches for the organization servers using recursively interconnected routines.Techniques such as Web Search, DNS Search, IP resolution, PTR Scanning, Bing IP, Common Names, DNS Prediction and Robtex are used in the process of server discovery in FOCA.Other features of FOCA include meshing Analysis, DNS Spoofing, Search for common files, Proxies search, Technology identification, Fingerprinting, Leaks, Backups search, Error forcing and open directory searches.Google Search (Search engines reconnaissance The magic weapons n.d.)Search tools are very respectable weapons for an attacker for conducting passive reconnaissance on an organization.Using Google search as a reconnaissance tools is 100% legal and this process does not involve approach pathing unauthorized data or files.Reconnaissance using google is done by using special search queries which are const ructed by search modifiers and search operators.Search modifiers are symbols such as + (Requires to match the term exactly), (Show all results excluding that match this term), * (Wildcard entry) and (Searching for a specific text, word or a phrase).Search operator includes keywords in the search queries such asAllintext Restricts search to contain all the query terms which you have specified.Allintitle Restricts search to contain all the titles which have the specified textAllin uniform resource locator Restricts search to contain all the url specified.Filetype Returns the search results which have a file which is specified by the user. For e.g. document filetypedoc will return all the documents with the file extension of .doc.Site Google will restrict the search to the particular site or domain.Using the above search modifiers and operators we can construct a special query. For e.g. we can construct a query to overreach all the doc files from www.example.com as sitewww.exam ple.com filetypedoc.From google search alone we can obtain important information like Staff lists and positions, Contact information, Technical skill, helpdesk FAQs, Security policies etc.DNSDumpster.comDNSDumpster is an online service that enables us to scan a particular website to return valuable information like all the DNS records of the website, all the hosts, domains, IPs, location and reverse DNS addresses.It also gives a graphical representation of the network map of the organization by the previously described data.We can even export all this information from the website to an excel spreadsheet to further analyze the data.WHOIS and TRACEROUTEWHOIS is a query and response protocol used to retrieve internet resources like domain names, IP address, owner information, webhost pinch information etc.Traceroute is a windows command which records the route through the web space or the internet from your computer to the destination address.PassiveRecon Mozilla Add-on (PassiveRecon n.d.)This very powerful Mozilla add-on combines various passive reconnaissance tools such as IP tracing, WHOIS, google search queries etc. into one single add-on which can use to perform a passive reconnaissance attack with a click of a button.Recon-ng (recon-ng n.d.)Recon-ng is a powerful tool made by the programmer LaNMaSteR53 which is a full-featured web based reconnaissance framework which is written in python.There is an inbuild module known as reconnaissance which is used for conducting all the passive reconnaissance on the website or web server.It gathers data such as IP information, domain names, hosts, location, related domains and other valuable information about the organization.It is a Linux tools and works with almost of the new Linux distributions such as kali or Ubuntu.SamSpade (SamSpade n.d.)SamSpade is a windows tools which is famously used for passive reconnaissance.This tools is used to query important functions such as regularise transfer, SMTP relay check, Sc an Addresses, Crawl Website, Browse Web, Fast and slow traceroutes, decode URL, parse email headers etc.NetCraft (netcraft n.d.)NetCraft is a United Kingdom based company which tracks almost all websites.Using this tool, we can obtain all the domains, site report with information like registrar information, location, DNS admin email address, hosting company, net stuff owner etc.It also enables us to look at the hosting history with the name and version of the webserver and display what web technologies have been used on the website.Information found after reconnaissanceDNS HostsBy using various reconnaissance tools ass mentioned above, we have pull together over 100 DNS hostnames for the website weather.com with additional information like IP addresses, reverse DNS, Netblock owner, commonwealth and webserver.The entire table of the gathered information is listed at the bottom of this document in a segregated tabular format for easy understanding.A network map has also been created from the above gathered DNS information and has been listed at the end of this document as well.We have also obtained the technologies used on the client stead of the weather.com website. These technologies include jQuery, Google Hosted libraries, AJAX, Angular JS and Modernizr.Extracted Files and MetadataUsing FOCA as well as google search queries, files were downloaded and analyzed from the weather.com server and host to reveal information about the organization like System Users, System paths, Software used and Clients connected to the server.Following are the list of user information which has been extracted from the metadata of the files gathered.Kerry McCordMaynard LindaiMarcFatima JantasriDavid TuftsLinda MaynardNeal SteinFollowing are the list of software package used to create, modify these files or used in the organization in world-wide.This data was extracted from over 159 documents which were gathered using FOCA and google search tools.Following are the Clients, Serv ers and Domains of weather.com gathered from server searching and analyzing file metadata.How the gathered information can be used by the attacker.The above-mentioned information although publicly available is very reclaimable for an attacker to orchestrate an attack on the website.With all the information, such as DNS hostname, IP address, Reverse DNS, Hosting server etc. the attacker can further use participating reconnaissance techniques on them to gather even more valuable information like the traffic on a particular server, capacity of a particular server, insecure protocols on the domain, SQL injection into form fields, DDoS attack on a particular sever etc.By recognizing a weak cerebrate in the network architecture of the organization, an attacker can find a way to enter into locations which was hidden from the public. By doing this the attacker can gain access to much more valuable information and further construct a stronger attack.With all the DNS address, available, th e attacker can run an active penetration test on these webserver and IP addresses to find out different vulnerabilities which can be exploited in the future.Serves with a large amount of network loads can be DDoSed to crash the organization website.User information was also gathered in this passive reconnaissance process which can be used to gain more knowledge about the people working in the organization and can be used for various social engineering attacks.These particular users can be targeted by email which could in turn compromise the systems they are in charge of.We now also know the software used in the organization and their version number.We can find out the vulnerabilities on that particular software and use that with social engineering to exploit a target system on the organization.By using all the information gathered by this passive reconnaissance process, the attacker is exposed to a lot of avenues on which he can further dive deep into using active reconnaissance or penetration testing methods.Suggested ControlsWe have to keep in mind that it is essential for a business to release public documents online.Thus, we have to make sure that these public documents do not give out any valuable information in the form of metadata or even the actual content of the document.These documents should be analyzed internally by the information security team before uploading them to the public website.We can even use a tool to locally extract and remove all the metadata from the file before we upload them to the website.We must also take active actions to harden the perimeter of our network.We must understand the devices that run on our network and update them with up to date security patches and releases.We should only release vague and general information to the public regarding domain names and registrar information.We should also disable and remove all those devices, web servers, users, accounts, domains which are not in use.We should also conduct penetrati on testing on our web servers and web sites periodically to further harden our network.We should also use NAT for as much of the network as possible. This helps to block OS fingerprinting and port scanning issues which are the main part of the active reconnaissance techniques.We should add a stateful firewall on the network perimeter to foresee any intrusion.We should also have a IDPS system to monitor the traffic on each web server and log the actions or report the actions.Tables and DiagramsDNS hostnames, IP addresses, Reverse DNS of weather.comHostnameIP AddressReverse DNSdmz.weather.com65.212.71.220dmz.weather.com65.212.71.221weather.com23.218.138.47a23-218-138-47.deploy.static.akamaitechnologies.comadcap0x00.twc.weather.com65.212.71.199adcap0x00.twc.weather.comadcap0x01.twc.weather.com65.212.71.198adcap0x01.twc.weather.comadserver-es1.weather.com96.8.82.170adserver.es1.dc.weather.comadserver-es2.weather.com96.8.83.170adserver.es2.dc.weather.comadserver-tc1.weather.com96.8.84.1 70adserver.twc1.dc.weather.comadserver-tc2.weather.com96.8.85.170adserver.twc2.dc.weather.comash-dc2-named-1.weather.com96.8.90.1ash-dc2-named-1.weather.comattpos.weather.com96.8.82.142attpos.weather.comattpos.weather.com96.8.84.142attpos.weather.comauth.twc1.dc.weather.com96.8.84.137auth.twc1.dc.weather.comb.twc1.dc.weather.com96.8.84.144b.twc1.dc.weather.comb.twc2.dc.weather.com96.8.85.144b.twc2.dc.weather.combackupmediadmz.twc.weather.com65.212.71.95backupmediadmz.twc.weather.combetaorigin.weather.com96.8.84.147betaorigin.weather.combetatest2.weather.com96.8.85.103betatest2.weather.comblogs.twc.weather.com65.212.71.97blogs.twc.weather.combuilddata.weather.com96.8.82.54builddata.weather.combuildds.weather.com96.8.82.49builddds.weather.combuildmap.weather.com96.8.82.56buildmap.weather.combuildmob.weather.com96.8.82.50buildmob.weather.combuildmob2.weather.com96.8.82.51buildmob2.weather.combuildorigin.weather.com96.8.82.53buildorigin.weather.combuildurs.weather.com96.8.82.52buildurs. weather.combuildweb.weather.com96.8.82.46buildweb.weather.combuildweb2.weather.com96.8.82.47buildweb2.weather.combuildwxii.weather.com96.8.82.48buildwxii.weather.comcacheds.twc1.dc.weather.com96.8.84.141cacheds.twc1.dc.weather.comcacheds.twc2.dc.weather.com96.8.85.141cacheds.twc2.dc.weather.comclustsrv1.twc.weather.com65.212.71.115clustsrv1.twc.weather.comclustsrv2.twc.weather.com65.212.71.116clustsrv2.twc.weather.comclustsrv3.twc.weather.com65.212.71.117clustsrv3.twc.weather.comclustsrv4.twc.weather.com65.212.71.121clustsrv4.twc.weather.comclustsrv5.twc.weather.com65.212.71.122clustsrv5.twc.weather.comconnect.twc.weather.com65.212.71.136connect.twc.weather.comdmzdc02.dmz.weather.com65.212.71.223dmzdc02.twc.weather.comdmzdc02.twc.weather.com65.212.71.223dmzdc02.twc.weather.comdmz.weather.com65.212.71.223dmzdc02.twc.weather.comdmzdc03.dmz.weather.com65.212.71.222dmzdc03.twc.weather.comdmzdc03.twc.weather.com65.212.71.222dmzdc03.twc.weather.comdmz.weather.com65.212.71.222dmzdc03.twc.w eather.comdmzswitch10.twc.weather.com65.212.71.10dmzswitch10.twc.weather.comdmzswitch11.twc.weather.com65.212.71.11dmzswitch11.twc.weather.comdmzswitch12.twc.weather.com65.212.71.12dmzswitch12.twc.weather.comdmzswitch13.twc.weather.com65.212.71.13dmzswitch13.twc.weather.comdmzswitch14.twc.weather.com65.212.71.14dmzswitch14.twc.weather.comdns1.weather.com96.8.82.15dns2.weather.comdns2.weather.com96.8.82.15dns2.weather.comdns3.weather.com96.8.84.15dns3.weather.comdsp-db.twc.weather.com65.212.71.119dsp-db.twc.weather.comdsq-db.twc.weather.com65.212.71.99dsq-db.twc.weather.comdualg.twc.weather.com65.202.103.100dualg.twc.weather.comarticles.weather.com52.200.156.65ec2-52-200-156-65.compute-1.amazonaws.comchef.dev.web.weather.com54.208.182.48ec2-54-208-182-48.compute-1.amazonaws.comapistatus.weather.com54.236.78.100ec2-54-236-78-100.compute-1.amazonaws.comcheckout.developer.weather.com54.69.68.23ec2-54-69-68-23.us-west-2.compute.amazonaws.comf5.twc.weather.com65.212.71.140f5.twc.weather.c omf5lab.dmz.weather.com65.212.71.66f5lab.dmz.weather.comf5vpn-lab.dmz.weather.com65.212.71.65f5vpn-lab.dmz.weather.comfaspex0b00.twc.weather.com65.212.71.48faspex0b00.twc.weather.comfaspex0b01.twc.weather.com65.212.71.49faspex0b01.twc.weather.comftp.twc.weather.com65.212.71.113ftp.twc.weather.comftp1.twc.weather.com65.212.71.108ftp1.twc.weather.comftp2.twc.weather.com65.212.71.109ftp2.twc.weather.comgiporigin.twc1.dc.weather.com96.8.84.166giporigin.twc1.dc.weather.comgiporigin.twc2.dc.weather.com96.8.85.166giporigin.twc2.dc.weather.comgwdmz.twc.weather.com65.212.71.1gwdmz.twc.weather.comhide135.twc.weather.com96.8.88.135hide135.twc.weather.comhide136.twc.weather.com65.202.103.136hide136.twc.weather.comhide139.twc.weather.com65.202.103.139hide139.twc.weather.comhide166.twc.weather.com65.202.103.166hide166.twc.weather.comhide167.twc.weather.com65.202.103.167hide167.twc.weather.comhide19.twc.weather.com65.202.103.19hide19.twc.weather.comhide20.twc.weather.com65.202.103.20hide20.twc.wea ther.comhide206.twc.weather.com65.202.103.206hide206.twc.weather.comhide207.twc.weather.com65.202.103.207hide207.twc.weather.comhide208.twc.weather.com65.202.103.208hide208.twc.weather.comhide209.twc.weather.com65.202.103.209hide209.twc.weather.comhide21.twc.weather.com96.8.88.21hide21.twc.weather.comhide22.twc.weather.com96.8.88.22hide22.twc.weather.comhide23.twc.weather.com96.8.88.23hide23.twc.weather.comhide24.twc.weather.com96.8.88.24hide24.twc.weather.comhide25.twc.weather.com96.8.88.25hide25.twc.weather.comhide250.twc.weather.com96.8.88.250hide250.twc.weather.comhide26.twc.weather.com96.8.88.26hide26.twc.weather.comhide27.twc.weather.com96.8.88.27hide27.twc.weather.comhide28.twc.weather.com96.8.88.28hide28.twc.weather.comhide29.twc.weather.com65.202.103.29hide29.twc.weather.comhide30.twc.weather.com65.202.103.30hide30.twc.weather.comhide31.twc.weather.com65.202.103.31hide31.twc.weather.comhide35.twc.weather.com65.202.103.35hide35.twc.weather.comiasq-app.twc.weather.com65.212.7 1.98iasq-app.twc.weather.comibp-db.twc.weather.com65.212.71.118ibp-db.twc.weather.comimwxsecure.twc1.dc.weather.com96.8.84.159imwxsecure.twc1.dc.weather.comimwxsecure.twc2.dc.weather.com96.8.85.159imwxsecure.twc2.dc.weather.comcareers.twc.weather.com65.212.71.129przrecruit01.dmz.weather.combes.twc.weather.com65.212.71.224przsccmdp01.dmz.weather.comgrid.weather.com54.231.49.82s3-website-us-east-1.amazonaws.comNetwork Map for weather.comn.d. FOCA. https//www.elevenpaths.com/labstools/foca/index.html.n.d. netcraft. https//www.netcraft.com/.n.d. PassiveRecon. https//addons.mozilla.org/en-US/firefox/addon/passiverecon/.n.d. recon-ng. https//bitbucket.org/LaNMaSteR53/recon-ng.n.d. SamSpade. https//www.sans.org/reading-room/whitepapers/tools/sam-spade-934.n.d. Search engines reconnaissance The magic weapons. http//securityaffairs.co/wordpress/19570/hacking/search-engines-reconnaissance-magic-weapons.html.