db-api.txt 20 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426
  1. ======================
  2. GeoDjango Database API
  3. ======================
  4. .. _spatial-backends:
  5. Spatial Backends
  6. ================
  7. .. module:: django.contrib.gis.db.backends
  8. :synopsis: GeoDjango's spatial database backends.
  9. GeoDjango currently provides the following spatial database backends:
  10. * ``django.contrib.gis.db.backends.postgis``
  11. * ``django.contrib.gis.db.backends.mysql``
  12. * ``django.contrib.gis.db.backends.oracle``
  13. * ``django.contrib.gis.db.backends.spatialite``
  14. .. _mysql-spatial-limitations:
  15. MySQL Spatial Limitations
  16. -------------------------
  17. Before MySQL 5.6.1, spatial extensions only support bounding box operations
  18. (what MySQL calls minimum bounding rectangles, or MBR). Specifically, MySQL did
  19. not conform to the OGC standard. Django supports spatial functions operating on
  20. real geometries available in modern MySQL versions. However, the spatial
  21. functions are not as rich as other backends like PostGIS.
  22. .. versionchanged:: 3.0
  23. Support for spatial functions operating on real geometries was added.
  24. .. warning::
  25. True spatial indexes (R-trees) are only supported with
  26. MyISAM tables on MySQL. [#fnmysqlidx]_ In other words, when using
  27. MySQL spatial extensions you have to choose between fast spatial
  28. lookups and the integrity of your data -- MyISAM tables do
  29. not support transactions or foreign key constraints.
  30. Raster Support
  31. --------------
  32. ``RasterField`` is currently only implemented for the PostGIS backend. Spatial
  33. lookups are available for raster fields, but spatial database functions and
  34. aggregates aren't implemented for raster fields.
  35. Creating and Saving Models with Geometry Fields
  36. ===============================================
  37. Here is an example of how to create a geometry object (assuming the ``Zipcode``
  38. model)::
  39. >>> from zipcode.models import Zipcode
  40. >>> z = Zipcode(code=77096, poly='POLYGON(( 10 10, 10 20, 20 20, 20 15, 10 10))')
  41. >>> z.save()
  42. :class:`~django.contrib.gis.geos.GEOSGeometry` objects may also be used to save geometric models::
  43. >>> from django.contrib.gis.geos import GEOSGeometry
  44. >>> poly = GEOSGeometry('POLYGON(( 10 10, 10 20, 20 20, 20 15, 10 10))')
  45. >>> z = Zipcode(code=77096, poly=poly)
  46. >>> z.save()
  47. Moreover, if the ``GEOSGeometry`` is in a different coordinate system (has a
  48. different SRID value) than that of the field, then it will be implicitly
  49. transformed into the SRID of the model's field, using the spatial database's
  50. transform procedure::
  51. >>> poly_3084 = GEOSGeometry('POLYGON(( 10 10, 10 20, 20 20, 20 15, 10 10))', srid=3084) # SRID 3084 is 'NAD83(HARN) / Texas Centric Lambert Conformal'
  52. >>> z = Zipcode(code=78212, poly=poly_3084)
  53. >>> z.save()
  54. >>> from django.db import connection
  55. >>> print(connection.queries[-1]['sql']) # printing the last SQL statement executed (requires DEBUG=True)
  56. INSERT INTO "geoapp_zipcode" ("code", "poly") VALUES (78212, ST_Transform(ST_GeomFromWKB('\\001 ... ', 3084), 4326))
  57. Thus, geometry parameters may be passed in using the ``GEOSGeometry`` object, WKT
  58. (Well Known Text [#fnwkt]_), HEXEWKB (PostGIS specific -- a WKB geometry in
  59. hexadecimal [#fnewkb]_), and GeoJSON [#fngeojson]_. Essentially, if the input is
  60. not a ``GEOSGeometry`` object, the geometry field will attempt to create a
  61. ``GEOSGeometry`` instance from the input.
  62. For more information creating :class:`~django.contrib.gis.geos.GEOSGeometry`
  63. objects, refer to the :ref:`GEOS tutorial <geos-tutorial>`.
  64. .. _creating-and-saving-raster-models:
  65. Creating and Saving Models with Raster Fields
  66. =============================================
  67. When creating raster models, the raster field will implicitly convert the input
  68. into a :class:`~django.contrib.gis.gdal.GDALRaster` using lazy-evaluation.
  69. The raster field will therefore accept any input that is accepted by the
  70. :class:`~django.contrib.gis.gdal.GDALRaster` constructor.
  71. Here is an example of how to create a raster object from a raster file
  72. ``volcano.tif`` (assuming the ``Elevation`` model)::
  73. >>> from elevation.models import Elevation
  74. >>> dem = Elevation(name='Volcano', rast='/path/to/raster/volcano.tif')
  75. >>> dem.save()
  76. :class:`~django.contrib.gis.gdal.GDALRaster` objects may also be used to save
  77. raster models::
  78. >>> from django.contrib.gis.gdal import GDALRaster
  79. >>> rast = GDALRaster({'width': 10, 'height': 10, 'name': 'Canyon', 'srid': 4326,
  80. ... 'scale': [0.1, -0.1], 'bands': [{"data": range(100)}]})
  81. >>> dem = Elevation(name='Canyon', rast=rast)
  82. >>> dem.save()
  83. Note that this equivalent to::
  84. >>> dem = Elevation.objects.create(
  85. ... name='Canyon',
  86. ... rast={'width': 10, 'height': 10, 'name': 'Canyon', 'srid': 4326,
  87. ... 'scale': [0.1, -0.1], 'bands': [{"data": range(100)}]},
  88. ... )
  89. .. _spatial-lookups-intro:
  90. Spatial Lookups
  91. ===============
  92. GeoDjango's lookup types may be used with any manager method like
  93. ``filter()``, ``exclude()``, etc. However, the lookup types unique to
  94. GeoDjango are only available on spatial fields.
  95. Filters on 'normal' fields (e.g. :class:`~django.db.models.CharField`)
  96. may be chained with those on geographic fields. Geographic lookups accept
  97. geometry and raster input on both sides and input types can be mixed freely.
  98. The general structure of geographic lookups is described below. A complete
  99. reference can be found in the :ref:`spatial lookup reference<spatial-lookups>`.
  100. Geometry Lookups
  101. ----------------
  102. Geographic queries with geometries take the following general form (assuming
  103. the ``Zipcode`` model used in the :doc:`model-api`)::
  104. >>> qs = Zipcode.objects.filter(<field>__<lookup_type>=<parameter>)
  105. >>> qs = Zipcode.objects.exclude(...)
  106. For example::
  107. >>> qs = Zipcode.objects.filter(poly__contains=pnt)
  108. >>> qs = Elevation.objects.filter(poly__contains=rst)
  109. In this case, ``poly`` is the geographic field, :lookup:`contains <gis-contains>`
  110. is the spatial lookup type, ``pnt`` is the parameter (which may be a
  111. :class:`~django.contrib.gis.geos.GEOSGeometry` object or a string of
  112. GeoJSON , WKT, or HEXEWKB), and ``rst`` is a
  113. :class:`~django.contrib.gis.gdal.GDALRaster` object.
  114. .. _spatial-lookup-raster:
  115. Raster Lookups
  116. --------------
  117. The raster lookup syntax is similar to the syntax for geometries. The only
  118. difference is that a band index can be specified as additional input. If no band
  119. index is specified, the first band is used by default (index ``0``). In that
  120. case the syntax is identical to the syntax for geometry lookups.
  121. To specify the band index, an additional parameter can be specified on both
  122. sides of the lookup. On the left hand side, the double underscore syntax is
  123. used to pass a band index. On the right hand side, a tuple of the raster and
  124. band index can be specified.
  125. This results in the following general form for lookups involving rasters
  126. (assuming the ``Elevation`` model used in the :doc:`model-api`)::
  127. >>> qs = Elevation.objects.filter(<field>__<lookup_type>=<parameter>)
  128. >>> qs = Elevation.objects.filter(<field>__<band_index>__<lookup_type>=<parameter>)
  129. >>> qs = Elevation.objects.filter(<field>__<lookup_type>=(<raster_input, <band_index>)
  130. For example::
  131. >>> qs = Elevation.objects.filter(rast__contains=geom)
  132. >>> qs = Elevation.objects.filter(rast__contains=rst)
  133. >>> qs = Elevation.objects.filter(rast__1__contains=geom)
  134. >>> qs = Elevation.objects.filter(rast__contains=(rst, 1))
  135. >>> qs = Elevation.objects.filter(rast__1__contains=(rst, 1))
  136. On the left hand side of the example, ``rast`` is the geographic raster field
  137. and :lookup:`contains <gis-contains>` is the spatial lookup type. On the right
  138. hand side, ``geom`` is a geometry input and ``rst`` is a
  139. :class:`~django.contrib.gis.gdal.GDALRaster` object. The band index defaults to
  140. ``0`` in the first two queries and is set to ``1`` on the others.
  141. While all spatial lookups can be used with raster objects on both sides, not all
  142. underlying operators natively accept raster input. For cases where the operator
  143. expects geometry input, the raster is automatically converted to a geometry.
  144. It's important to keep this in mind when interpreting the lookup results.
  145. The type of raster support is listed for all lookups in the :ref:`compatibility
  146. table <spatial-lookup-compatibility>`. Lookups involving rasters are currently
  147. only available for the PostGIS backend.
  148. .. _distance-queries:
  149. Distance Queries
  150. ================
  151. Introduction
  152. ------------
  153. Distance calculations with spatial data is tricky because, unfortunately,
  154. the Earth is not flat. Some distance queries with fields in a geographic
  155. coordinate system may have to be expressed differently because of
  156. limitations in PostGIS. Please see the :ref:`selecting-an-srid` section
  157. in the :doc:`model-api` documentation for more details.
  158. .. _distance-lookups-intro:
  159. Distance Lookups
  160. ----------------
  161. *Availability*: PostGIS, Oracle, SpatiaLite, PGRaster (Native)
  162. The following distance lookups are available:
  163. * :lookup:`distance_lt`
  164. * :lookup:`distance_lte`
  165. * :lookup:`distance_gt`
  166. * :lookup:`distance_gte`
  167. * :lookup:`dwithin`
  168. .. note::
  169. For *measuring*, rather than querying on distances, use the
  170. :class:`~django.contrib.gis.db.models.functions.Distance` function.
  171. Distance lookups take a tuple parameter comprising:
  172. #. A geometry or raster to base calculations from; and
  173. #. A number or :class:`~django.contrib.gis.measure.Distance` object containing the distance.
  174. If a :class:`~django.contrib.gis.measure.Distance` object is used,
  175. it may be expressed in any units (the SQL generated will use units
  176. converted to those of the field); otherwise, numeric parameters are assumed
  177. to be in the units of the field.
  178. .. note::
  179. In PostGIS, ``ST_Distance_Sphere`` does *not* limit the geometry types
  180. geographic distance queries are performed with. [#fndistsphere15]_ However,
  181. these queries may take a long time, as great-circle distances must be
  182. calculated on the fly for *every* row in the query. This is because the
  183. spatial index on traditional geometry fields cannot be used.
  184. For much better performance on WGS84 distance queries, consider using
  185. :ref:`geography columns <geography-type>` in your database instead because
  186. they are able to use their spatial index in distance queries.
  187. You can tell GeoDjango to use a geography column by setting ``geography=True``
  188. in your field definition.
  189. For example, let's say we have a ``SouthTexasCity`` model (from the
  190. :source:`GeoDjango distance tests <tests/gis_tests/distapp/models.py>` ) on a
  191. *projected* coordinate system valid for cities in southern Texas::
  192. from django.contrib.gis.db import models
  193. class SouthTexasCity(models.Model):
  194. name = models.CharField(max_length=30)
  195. # A projected coordinate system (only valid for South Texas!)
  196. # is used, units are in meters.
  197. point = models.PointField(srid=32140)
  198. Then distance queries may be performed as follows::
  199. >>> from django.contrib.gis.geos import GEOSGeometry
  200. >>> from django.contrib.gis.measure import D # ``D`` is a shortcut for ``Distance``
  201. >>> from geoapp.models import SouthTexasCity
  202. # Distances will be calculated from this point, which does not have to be projected.
  203. >>> pnt = GEOSGeometry('POINT(-96.876369 29.905320)', srid=4326)
  204. # If numeric parameter, units of field (meters in this case) are assumed.
  205. >>> qs = SouthTexasCity.objects.filter(point__distance_lte=(pnt, 7000))
  206. # Find all Cities within 7 km, > 20 miles away, and > 100 chains away (an obscure unit)
  207. >>> qs = SouthTexasCity.objects.filter(point__distance_lte=(pnt, D(km=7)))
  208. >>> qs = SouthTexasCity.objects.filter(point__distance_gte=(pnt, D(mi=20)))
  209. >>> qs = SouthTexasCity.objects.filter(point__distance_gte=(pnt, D(chain=100)))
  210. Raster queries work the same way by simply replacing the geometry field
  211. ``point`` with a raster field, or the ``pnt`` object with a raster object, or
  212. both. To specify the band index of a raster input on the right hand side, a
  213. 3-tuple can be passed to the lookup as follows::
  214. >>> qs = SouthTexasCity.objects.filter(point__distance_gte=(rst, 2, D(km=7)))
  215. Where the band with index 2 (the third band) of the raster ``rst`` would be
  216. used for the lookup.
  217. .. _compatibility-table:
  218. Compatibility Tables
  219. ====================
  220. .. _spatial-lookup-compatibility:
  221. Spatial Lookups
  222. ---------------
  223. The following table provides a summary of what spatial lookups are available
  224. for each spatial database backend. The PostGIS Raster (PGRaster) lookups are
  225. divided into the three categories described in the :ref:`raster lookup details
  226. <spatial-lookup-raster>`: native support ``N``, bilateral native support ``B``,
  227. and geometry conversion support ``C``.
  228. ================================= ========= ======== ============ ========== ========
  229. Lookup Type PostGIS Oracle MySQL [#]_ SpatiaLite PGRaster
  230. ================================= ========= ======== ============ ========== ========
  231. :lookup:`bbcontains` X X X N
  232. :lookup:`bboverlaps` X X X N
  233. :lookup:`contained` X X X N
  234. :lookup:`contains <gis-contains>` X X X X B
  235. :lookup:`contains_properly` X B
  236. :lookup:`coveredby` X X X B
  237. :lookup:`covers` X X X B
  238. :lookup:`crosses` X X C
  239. :lookup:`disjoint` X X X X B
  240. :lookup:`distance_gt` X X X N
  241. :lookup:`distance_gte` X X X N
  242. :lookup:`distance_lt` X X X N
  243. :lookup:`distance_lte` X X X N
  244. :lookup:`dwithin` X X X B
  245. :lookup:`equals` X X X X C
  246. :lookup:`exact` X X X X B
  247. :lookup:`intersects` X X X X B
  248. :lookup:`isvalid` X X X (≥ 5.7.5) X (LWGEOM)
  249. :lookup:`overlaps` X X X X B
  250. :lookup:`relate` X X X C
  251. :lookup:`same_as` X X X X B
  252. :lookup:`touches` X X X X B
  253. :lookup:`within` X X X X B
  254. :lookup:`left` X C
  255. :lookup:`right` X C
  256. :lookup:`overlaps_left` X B
  257. :lookup:`overlaps_right` X B
  258. :lookup:`overlaps_above` X C
  259. :lookup:`overlaps_below` X C
  260. :lookup:`strictly_above` X C
  261. :lookup:`strictly_below` X C
  262. ================================= ========= ======== ============ ========== ========
  263. .. _database-functions-compatibility:
  264. Database functions
  265. ------------------
  266. The following table provides a summary of what geography-specific database
  267. functions are available on each spatial backend.
  268. .. currentmodule:: django.contrib.gis.db.models.functions
  269. ==================================== ======= ============== =========== ==========
  270. Function PostGIS Oracle MySQL SpatiaLite
  271. ==================================== ======= ============== =========== ==========
  272. :class:`Area` X X X X
  273. :class:`AsGeoJSON` X X (≥ 5.7.5) X
  274. :class:`AsGML` X X X
  275. :class:`AsKML` X X
  276. :class:`AsSVG` X X
  277. :class:`Azimuth` X X (LWGEOM)
  278. :class:`BoundingCircle` X X
  279. :class:`Centroid` X X X X
  280. :class:`Difference` X X X X
  281. :class:`Distance` X X X X
  282. :class:`Envelope` X X X X
  283. :class:`ForcePolygonCW` X X
  284. :class:`GeoHash` X X (≥ 5.7.5) X (LWGEOM)
  285. :class:`Intersection` X X X X
  286. :class:`IsValid` X X X (≥ 5.7.5) X (LWGEOM)
  287. :class:`Length` X X X X
  288. :class:`LineLocatePoint` X X
  289. :class:`MakeValid` X X (LWGEOM)
  290. :class:`MemSize` X
  291. :class:`NumGeometries` X X X X
  292. :class:`NumPoints` X X X X
  293. :class:`Perimeter` X X X
  294. :class:`PointOnSurface` X X X
  295. :class:`Reverse` X X X
  296. :class:`Scale` X X
  297. :class:`SnapToGrid` X X
  298. :class:`SymDifference` X X X X
  299. :class:`Transform` X X X
  300. :class:`Translate` X X
  301. :class:`Union` X X X X
  302. ==================================== ======= ============== =========== ==========
  303. Aggregate Functions
  304. -------------------
  305. The following table provides a summary of what GIS-specific aggregate functions
  306. are available on each spatial backend. Please note that MySQL does not
  307. support any of these aggregates, and is thus excluded from the table.
  308. .. currentmodule:: django.contrib.gis.db.models
  309. ======================= ======= ====== ==========
  310. Aggregate PostGIS Oracle SpatiaLite
  311. ======================= ======= ====== ==========
  312. :class:`Collect` X X
  313. :class:`Extent` X X X
  314. :class:`Extent3D` X
  315. :class:`MakeLine` X X
  316. :class:`Union` X X X
  317. ======================= ======= ====== ==========
  318. .. rubric:: Footnotes
  319. .. [#fnwkt] *See* Open Geospatial Consortium, Inc., `OpenGIS Simple Feature Specification For SQL <http://www.opengis.org/docs/99-049.pdf>`_, Document 99-049 (May 5, 1999), at Ch. 3.2.5, p. 3-11 (SQL Textual Representation of Geometry).
  320. .. [#fnewkb] *See* `PostGIS EWKB, EWKT and Canonical Forms <https://postgis.net/docs/using_postgis_dbmanagement.html#EWKB_EWKT>`_, PostGIS documentation at Ch. 4.1.2.
  321. .. [#fngeojson] *See* Howard Butler, Martin Daly, Allan Doyle, Tim Schaub, & Christopher Schmidt, `The GeoJSON Format Specification <http://geojson.org/geojson-spec.html>`_, Revision 1.0 (June 16, 2008).
  322. .. [#fndistsphere15] *See* `PostGIS documentation <https://postgis.net/docs/ST_DistanceSphere.html>`_ on ``ST_DistanceSphere``.
  323. .. [#fnmysqlidx] *See* `Creating Spatial Indexes <https://dev.mysql.com/doc/refman/en/creating-spatial-indexes.html>`_
  324. in the MySQL Reference Manual:
  325. For MyISAM tables, ``SPATIAL INDEX`` creates an R-tree index. For storage
  326. engines that support nonspatial indexing of spatial columns, the engine
  327. creates a B-tree index. A B-tree index on spatial values will be useful
  328. for exact-value lookups, but not for range scans.
  329. .. [#] Refer :ref:`mysql-spatial-limitations` section for more details.