layout:true <p class="footer"> <span xmlns:dct="http://purl.org/dc/terms/" property="dct:title">Introduction to GIS Fundamentals</span> by <a xmlns:cc="http://creativecommons.org/ns#" href="http://www.datapolitan.com" property="cc:attributionName" rel="cc:attributionURL">Richard Dunks, Eric Brelsford, and Beth Pappas</a> is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">Creative Commons Attribution-ShareAlike 4.0 International License</a>.<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/"><img alt="Creative-Commons-License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/80x15.png" /></a> </p> --- class: center,middle  - - - # Introduction to GIS Fundamentals ## Richard Dunks, Co-Instructor<br>Eric Brelsford, Co-Instructor ## Bernardo Loureiro, TA ### Follow along: http://bit.ly/intro-gis-fundamentals #### See the code at: http://bit.ly/intro-gis-fundamentals-code --- # Introductions + Name + Department / Job + One thing you hope to get out of class today --- # Goals for the class -- + Describe the foundational concepts of spatial analysis and mapmaking -- + Describe the general structure and purpose of Geographic Information Systems (GIS) -- + Describe spatial data formats and sources of spatial data -- + Apply concepts of spatial analysis using NYC Open Data to answer an NYC-related problem -- + Discuss resources for further information and instruction on QGIS and other spatial analysis tools --- # Outcomes -- + You will be familiar with the foundational concepts in spatial analysis and mapmaking -- + You will understand the structure and purpose of GIS -- + You will be practiced in applying spatial concepts to real-world problems -- + You will be familiar with the differences between open source and proprietary software applications -- + You will be familiar with resources for further information on how to use QGIS for spatial analysis and mapmaking --- # Goals for this morning -- + Review basic geospatial principles and GIS tools -- + Discuss spatial data formats -- + Demonstrate and practice how to load, filter, and select data in QGIS -- + Demonstrate and practice how to style spatial data -- + Demonstrate and practice how to export data from QGIS --- class:center,middle # Why Do We Create Maps? --- class:center,middle # Types of Maps --- # General Reference Maps -- + Show important physical features of an area -- + Include natural and man-made features -- + Usually meant to help aid in the navigation or discovery of locations -- + Usually fairly simple -- + Can be stylized based on the intended audience (tourists vs locals) --- class:center,middle  ##### Source: http://nationalmap.gov/small_scale/printable/reference.html --- # Thematic Maps -- + Focuses on a specific theme or subject area -- + Features on the map represent the phenomenon being mapped -- + Spatial features used for reference ---  ##### Source: http://www.usna.usda.gov/Hardzone/ushzmap.html --- # Choropleth  ##### Source: http://www.geogalot.com/myp-humanities/year-9/understanding-hazards/003---choropleth-mapping --- # Choropleth  ##### Source: http://www.floatingsheep.org/2012/07/church-or-beer-americans-on-twitter.html --- # Area Cartogram – Electoral Votes by State  ##### Source: http://training.fws.gov/courses/csp/csp7203/resources/Types_of_Maps_2013.pdf --- # Dorling Cartogram – Obesity by State  ##### Source: http://homes.cs.washington.edu/~jheer//files/zoo/ --- class:center,middle # Basic Map Elements --- # Points  #### Source: http://docs.qgis.org/2.8/en/docs/gentle_gis_introduction/vector_data.html#overview --- # Lines  #### Source: http://docs.qgis.org/2.8/en/docs/gentle_gis_introduction/vector_data.html#overview --- # Polygons  #### Source: http://docs.qgis.org/2.8/en/docs/gentle_gis_introduction/vector_data.html#overview --- class:center,middle # How do we make maps? --- # Geographic Information System (GIS) > Any system for capturing, storing, checking, and displaying data related to positions on the Earth's surface + [National Geographic Education Encyclopedia](http://education.nationalgeographic.org/encyclopedia/geographic-information-system-gis/) --- # Or more simply > In a GIS, you connect _**data**_ with _**geography**_. + [GISgeography.com](http://gisgeography.com/what-gis-geographic-information-systems/) --- # Geographic Information Systems (GIS) -- + Create interactive queries (user-created searches) -- + Analyze spatial information -- + Edit data in maps -- + Present the results of all these operations --- # Basic Map Using QGIS  --- #[QGIS](http://www.qgis.org/)  Source: [NYC Open Data Portal 311 Service Requests](https://data.cityofnewyork.us/Social-Services/311-Service-Requests-from-2010-to-Present/erm2-nwe9), DOT Responsible Agency 1 January - 30 June 2015 --- # QGIS - The Good -- + Freely available desktop application -- + Lots of features -- + Works with different data types -- + A strong community developing new features and plug-ins --- # QGIS - The Bad -- + A bit bug-y sometimes -- + Visual style is a little clunky -- + Features change between versions -- + It will crash (but so will ArcGIS) --- # QGIS - The Bug-y -- + Sometimes things get jumbled -> zoom out then zoom back in -- + Things don't work properly -> close and restart -- + Other problems that we'll find in class --- <!-- opening shapefile --> # Let's Get Started 1. [Click this link](data/boros/boros.zip) and download the file to your desktop 2. Unzip the file 3. Open QGIS  --- # QGIS Getting Started  --- # QGIS Getting Started  ---   --- # QGIS Getting Started  --- # Attribute Table (Right click on layer)  --- # Attribute Table  --- <!-- Styling --> # Styling Features + Right-click the layer and select the Properties option + Select "Style," and finally, choose "Categorized":  --- # Styling Features + Select the column that has the data you want to style:   --- # Styling Features  --- # Styling Features  --- # Add labels to data + From Properties, select "Labels", "Show labels for this layer"  --- # Add labels to data + Select the column that has the data you want to use for labels  + Click "Apply", "Ok" --- # Add labels to data  --- # Styling Labels  --- # Styling Labels  --- # Your turn + Style the polygons however you'd like + Change the outline color or add a pattern + Style the labels + Change the font, the font size, or other attributes --- class: center, middle #5 Min Break  ##### Source: https://www.instagram.com/sadtopographies/ --- # Layers  #### Image Source: http://www.geocontrolling.com/co-je-gis.htm --- # Shapefiles -- + Basic file for storing map elements -- + Stores spatial data, like points, lines, and polygons -- + Multiple files comprise a "shapefile" --  --- # Shapefiles  -- + .shp—The main file that stores the feature geometry -- + .dbf—The dBASE table that stores the attribute information of features --- # Shapefiles  + .prj—The file that stores the coordinate system information -- + .shx—The index file that stores the index of the feature geometry --- # You might also see -- + .cpg—Identifies the character set to be used -- + .sbn and .sbx—The files that store the spatial index of the features --- # Shapefiles + Have a few limitations -- + One geometry type (Point, Line, Polygon) per shapefile -- + So sometimes you end up with this:  --- # Shapefiles -- + Column names can only be letters, numbers, and underscores "_" -- + Column names can only be ten characters long --  --- class:center,middle # Let's add another layer --- #311 DOT Service Requests + [Download the data](data/dot-311/20160201_20160207_DOT_311_ServiceRequests.zip) to your desktop + Unzip the file + Open in QGIS  --- #311 DOT Service Requests  --- # Layer Ordering -- + Layers on top are drawn on top -- + Just drag and drop within the Layers Panel to change order -- + Try it now --- # Filter and Query + We can filter the points based on the values in the attribute table --- # Filter and Query + Right-click on the layer and select "Filter" to open the Query Builder  --- # Filter and Query  --- # Filter and Query  --  --- # Filter and Query  --- # Filter and Query  --- class:center,middle # We can also filter by multiple conditions --- # Filter and Query - Multiple Conditions  --  --- # Filter and Query - Multiple Conditions  --- # Zoom to Layer  --- # Zoom to Layer  --- # Zoom Selection -- + Select the zoom on the toolbar --  -- + Draw a box around the area you want to zoom into -- + Click the icon to return to the previous map extent --  --- # Pan Map + Select the hand tool to pan around the map  --- # Exporting Data  --  --- # Your Turn + Filter for service requests in your borough + Try and find something interesting + Change the style of the point, either to a different shape, color, or icon + Export your selection as a new shapefile --- class:center #10 Min Break  #### Source: https://www.instagram.com/sadtopographies/ --- # Let's add another layer + [Right click this link](data/Parking_Facilities.csv) + Select "Save link as" + Save the file (`Parking_Facilities.csv`) to your desktop --- # What is a CSV file? --  --- # What is a CSV file?  --- # Adding CSV Data  ---  --  --- # Adding CSV Data  --- # Adding CSV Data  --- class:center,middle # So what is a Coordinate Reference System? --- # Projections -- + No one's favorite part of GIS -- + But a necessary part of it nonetheless -- + Convert points on the 3-dimensional Earth (**latitude** and **longitude**) to x and y coordinates on a 2-dimensional map --  [Digital Coast Geozone](https://geozoneblog.wordpress.com/2012/05/22/happy-birthday-mercator/) --- # Projections + Every projection distorts some part of your map  [FlowingData](http://flowingdata.com/2014/01/13/map-projections-illustrated-with-a-face/) --- # Mercator Projections -- + A common map projection -- + Makes geometries near poles look bigger than geometries near the equator --  --- # Projections Matter -- + These circles are all the same size on the globe:  [Progonos](http://www.progonos.com/furuti/MapProj/Normal/CartProp/Distort/distort.html) --- # Projections Matter + As are these:  [Progonos](http://www.progonos.com/furuti/MapProj/Normal/CartProp/Distort/distort.html) --- # Projections Matter + And these:  [Progonos](http://www.progonos.com/furuti/MapProj/Normal/CartProp/Distort/distort.html) --- # Projections Matter  --- # Projections + For the most part we will work in **WGS 84** (latitude and longitude) -- + In NYC, we use a more accurate projection **NY State Plane/Long Island Zone**  ###### Source: https://alidade.wikispaces.com/New+York+SPCS+Zones --- # Projections + Identified by unique IDs that make it easier to talk about them -- + WGS 84 is referred to as **EPSG:4326** -- + State Plane Long Island is referred to as **EPSG:2263** -- ## Remember these two and you should be set --- class:center,middle # Back to Adding CSV Data --- # Adding CSV Data  --- # Adding CSV Data  --- # Saving CSV Data as a Shapefile  --  --- # Selecting Points  --- # Selecting Points  -- + Click the point  --- # Selecting Points  --- # Selecting Points - Attribute Table  --- # Selecting Points - Attribute Table  --  --- # Selecting Points - Saving Selection  --- # Selecting Points - Saving Selection + If we wanted to reproject the data into a different CRS, we could do that here --  -- + Pick the new projection in the CRS field (like when we imported the CSV) --- # What We've Covered -- + What is GIS -- + Basic GIS concepts and tools -- + Adding, styling, and labeling data in QGIS -- + Projections -- + Selecting features -- + Exporting data --- class:center,middle # LUNCH  #### Source: https://www.instagram.com/sadtopographies/ --- class: center,middle # Welcome Back! ## https://youtu.be/vVX-PrBRtTY --- class: center,middle # Tell us one thing you learned this morning that you found useful, interesting, and/or helpful --- class:center,middle # What do you think of QGIS so far? --- # Goals for the Afternoon -- + Add reference data to our maps -- + Learn how to join features in QGIS -- + Create printable maps in QGIS -- + Share resources for further learning --- class:center,middle # What have our maps been lacking? --- # Base Maps  #### Image Source: http://www.geocontrolling.com/co-je-gis.htm --- # Base Maps  --- # Base Maps -- + Adding base maps will give your map context -- + In QGIS, you need a plugin to use base maps -- + There are several, but we're only going to use one of them --- # Base Map Plugin + From the Plugins menu, select "Manage and Install Plugins"  --- # Base Map Plugin + Search for the QuickMapServices plugin and install it  --- # Setting Up QuickMapServices Plugin + Go to the Settings Menu  --- # Setting Up QuickMapServices Plugin + Get the contributed packs  --- # Setting Up QuickMapServices Plugin + Revel in all the beautiful base maps  --- # Choosing a Base Map -- + Think about what someone reading your map needs to see for context -- + Think about how the base map interacts with the data on your map --- # Base Maps - Hierarchy -- + If your data is the most important part of the map, make sure it looks more important than the base map -- + Avoid base maps that strongly emphasize features that aren't relevant on your map --- # Base Maps - Colors -- + Choose base maps with colors that complement the colors on your map -- + The contrast between the color on your map and the color on the base map should be enough to make your layers clearly visible --- # Base Maps - Scale  #### Source: http://go.owu.edu/~jbkrygie/krygier_html/geog_222/geog_222_lo/geog_222_lo04.html --- # Base Maps - Scale + Base maps show different levels of detail at different scales -- + Make sure the level of detail is appropriate to your map --- # Scale  --- # Scale  --- # Your Turn + Find a good base map for your data + Think about hierarchy, color, and scale + Don't be afraid to play around --- class:center,middle #5 Min Break  #### Source: https://www.instagram.com/sadtopographies/ --- # Basic Spatial Joins  -- ## Point to Polygon + Relate points inside a polygon to that polygon (ex. count the number of points) -- ## Polygon to Point + Points can take on value of enclosing polygon --- # What are some of the spatial joins we could do with this data?  --- class:center,middle # Let's do one together --- # Parking facilities by borough  --- # Parking facilities by borough  --- # Parking facilities by borough  --  --  --- # Reproject the boroughs shapefile into 4326  --- # Reproject the boroughs shapefile into 4326  --- # Parking facilities by borough  --  --- # Parking facilities by borough  --- # Parking facilities by borough  --- # Your Turn + Count the number of DOT 311 service requests in each [community district](data/nycd_16a/nycd_16a.zip) in your borough + Style the community districts by the number of service requests --- class:center,middle #10 Min Break  #### Source: https://www.instagram.com/p/BCbMlYZD89p/ --- # Print Composer -- + How you make exportable and printable maps in QGIS -- + Able to add map elements (legends, scales, text, etc) --  --- # Create a new print composer  --  --- # You are greeted with a blank slate  --- # Add New Map tool will add your current map  --  --- # Customize item properties on the right  --- # Don't forget a title and your sources   --- # There are a few exporting options  --- # Now you can share your map or print it  --- # Print Composer Problems + Map extent -> "Use current map extent" + Moving map around -> Adjust with arrows + "North" arrow -> need to manually align --- class:center,middle #[Click to submit your work](https://script.google.com/a/macros/datapolitan.com/s/AKfycbwMcE5pcJwZHdbSCN_2epwaXnRLSRPaLbHCAhxaZJ79UXaRpQ_l/exec) --- class:center,middle # Presentations --- class:center,middle # Take a moment to email your map to yourself --- # What We've Covered This Afternoon -- + Adding base maps to QGIS -- + Installing plug-ins -- + Joining data -- + Creating a printable map in print composer --- # Some Other GIS Tools  --- #[ArcGIS](http://www.esri.com/software/arcgis/arcgis-for-desktop)  [Source](http://www.esri.com/news/arcuser/1012/a-workflow-for-creating-and-sharing-maps.html) --- #[Adobe Illustrator](http://www.adobe.com/products/illustrator.html)/[Mapublisher](http://www.avenza.com/mapublisher)  [Source](http://www.avenza.com/resources/blog/2011/06/28/how-get-open-street-map-data-adobe-illustrator-mapublisher) --- #[Google Earth](https://www.google.com/earth/)  --- #[Google Fusion Tables](https://sites.google.com/site/fusiontablestalks/stories) <iframe width="100%" height="430" scrolling="no" frameborder="no" src="https://www.google.com/fusiontables/embedviz?q=select+col54%2C+col55+from+1dNtdy7FuBBZ2qTxX7jgZ5Dig8n96oxRrWFjuhYpJ+where+col3+%3E%3D+0+and+col3+%3C%3D+4+and+col26+%3D+2+limit+1000&viz=HEATMAP&h=true&lat=40.844685&lng=-73.915349&t=1&z=12&l=col54&y=2&tmplt=2&hmd=true&hmg=%2366ff0000%2C%2393ff00ff%2C%23c1ff00ff%2C%23eeff00ff%2C%23f4e300ff%2C%23f4e300ff%2C%23f9c600ff%2C%23ffaa00ff%2C%23ff7100ff%2C%23ff3900ff%2C%23ff0000ff&hmo=0.6&hmr=26&hmw=0&hml=TWO_COL_LAT_LNG"></iframe> Source: [NYC Open Data 311 Noise Complaints, 1 Jan - 20 May 2014, Between Midnight and 4 am in the Bronx](https://www.google.com/fusiontables/DataSource?docid=1dNtdy7FuBBZ2qTxX7jgZ5Dig8n96oxRrWFjuhYpJ# map:id=3) --- # Proprietary vs Open Source Software -- + Proprietary software source code is owned by an individual or an organization and tightly restricted (usually for profit) -- + Open source software source code is freely available to anyone for download, alteration, and republishing --- # Proprietary vs Open Source Software -- + Proprietary software code is generally supported by a team of paid professionals working for the organization that owns the code -- + Open source software code is generally supported by a mix of paid and volunteer professionals that contribute changes back to the community --- # Proprietary vs Open Source Software -- + Proprietary software is often available only by purchasing a license -- + Open source software is free to use though there generally a license that specifies the restrictions (if any) on its use and reuse -- + Companies using open source software may charge for the use of the software through their proprietary implementations or via their infrastructure --- class:center,middle # Examples of Open Source Mapping Software --- #[CartoDB](https://cartodb.com/) <iframe width="100%" height="480" frameborder="0" src="https://richard-datapolitan.cartodb.com/viz/c0d4f39e-962e-11e4-9b3b-0e9d821ea90d/embed_map" allowfullscreen webkitallowfullscreen mozallowfullscreen oallowfullscreen msallowfullscreen></iframe> --- # A Few Things We Didn't Talk About -- + Normalizing data for choropleths ([see this video](https://www.youtube.com/watch?v=t1RvSxNcafU)) -- + Buffering features -- + Geocoding -- + Spatial databases -- + Other spatial data types (KML, GeoJSON, GeoTIFF) -- + Editing data --- # QGIS - The Good -- + Open-source software that’s freely available -- + Works with lots of different data types, including shapefiles, KML (Google Earth), GeoJSON, and text files -- + Works with various spatial databases -- + Strong community developing features and plug-ins --- # QGIS - The Bad -- + Not an enterprise software like ESRI ArcGIS -- + The visual style is a little clunky -- + Features tend to change between versions (moving around, menu option changes, etc) -- + Major versions tend to have major feature changes -- + Plug-ins tend not to work with newer versions -- + And it crashes (as you've probably already experienced) --- # And of course...  --- # QGIS - The Bug-y -- + Projects with different CRS layers tend to get misaligned when zooming -- + _Zoom in and then back out to fix_ -- + Google base maps tend not to appear on load -- + _Have to zoom in to get them to appear_ -- + Other odd behavior that they’re hopefully working on -- + _File them here: https://hub.qgis.org/wiki/17/Bugreports_ --- class:center,middle # Good Resources for Further Information --- # GIS Stack Exchange  [GIS Stack Exchange](http://gis.stackexchange.com/) --- # Learning QGIS  [Learning QGIS](https://www.packtpub.com/application-development/learning-qgis-20) --- # QGIS Map Design  [QGIS Map Design](http://locatepress.com/qmd) --- # Other Documentation + [QGIS online manual Gentle GIS Introduction](http://docs.qgis.org/2.8/en/docs/gentle_gis_introduction) + [QGIS Tutorials and Tips](http://www.qgistutorials.com/en/index.html) + [Free and Open Source GIS Ramblings](https://anitagraser.com/) --- class:middle  --- # Reminders -- + Know your layer CRS -- + When in doubt, zoom in and then zoom out -- + If you’re working with a CSV file and run into an error, export as a shapefile and try it again -- + Save your project often -- + Choose good file names --- # Final Thoughts -- + Maps are a great way to visualize and explore spatial data -- + Some data is only intelligible when mapped -- + QGIS is a cheap (as in free) way to get started -- + There are many resources online for how to use QGIS and other GIS applications -- + Share what you know with others -> Data wants to be mapped --- class:center,middle # Thank You ##[Please take a moment to share your thoughts on this class](http://goo.gl/forms/N8j5imC8ww) --- ## Richard Dunks, Co-Instructor + [richard@datapolitan.com](mailto:richard@datapolitan.com) + [@rdunks1](https://twitter.com/rdunks1)/[@datapolitan](https://twitter.com/Datapolitan) ## Eric Brelsford, Co-Instructor + [ebrelsford@gmail.com](mailto:ebrelsford@gmail.com) + [@ebrelsford](https://twitter.com/ebrelsford) ## Bernardo Loureiro, TA