aggregates.txt 11 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357
  1. =========================================
  2. PostgreSQL specific aggregation functions
  3. =========================================
  4. .. module:: django.contrib.postgres.aggregates
  5. :synopsis: PostgreSQL specific aggregation functions
  6. These functions are available from the ``django.contrib.postgres.aggregates``
  7. module. They are described in more detail in the `PostgreSQL docs
  8. <https://www.postgresql.org/docs/current/functions-aggregate.html>`_.
  9. .. note::
  10. All functions come without default aliases, so you must explicitly provide
  11. one. For example::
  12. >>> SomeModel.objects.aggregate(arr=ArrayAgg('somefield'))
  13. {'arr': [0, 1, 2]}
  14. .. admonition:: Common aggregate options
  15. All aggregates have the :ref:`filter <aggregate-filter>` keyword argument
  16. and most also have the :ref:`default <aggregate-default>` keyword argument.
  17. General-purpose aggregation functions
  18. =====================================
  19. ``ArrayAgg``
  20. ------------
  21. .. class:: ArrayAgg(expression, distinct=False, filter=None, default=None, ordering=(), **extra)
  22. Returns a list of values, including nulls, concatenated into an array, or
  23. ``default`` if there are no values.
  24. .. attribute:: distinct
  25. An optional boolean argument that determines if array values
  26. will be distinct. Defaults to ``False``.
  27. .. attribute:: ordering
  28. An optional string of a field name (with an optional ``"-"`` prefix
  29. which indicates descending order) or an expression (or a tuple or list
  30. of strings and/or expressions) that specifies the ordering of the
  31. elements in the result list.
  32. Examples::
  33. 'some_field'
  34. '-some_field'
  35. from django.db.models import F
  36. F('some_field').desc()
  37. .. deprecated:: 4.0
  38. If there are no rows and ``default`` is not provided, ``ArrayAgg``
  39. returns an empty list instead of ``None``. This behavior is deprecated
  40. and will be removed in Django 5.0. If you need it, explicitly set
  41. ``default`` to ``Value([])``.
  42. ``BitAnd``
  43. ----------
  44. .. class:: BitAnd(expression, filter=None, default=None, **extra)
  45. Returns an ``int`` of the bitwise ``AND`` of all non-null input values, or
  46. ``default`` if all values are null.
  47. ``BitOr``
  48. ---------
  49. .. class:: BitOr(expression, filter=None, default=None, **extra)
  50. Returns an ``int`` of the bitwise ``OR`` of all non-null input values, or
  51. ``default`` if all values are null.
  52. ``BitXor``
  53. ----------
  54. .. versionadded:: 4.1
  55. .. class:: BitXor(expression, filter=None, default=None, **extra)
  56. Returns an ``int`` of the bitwise ``XOR`` of all non-null input values, or
  57. ``default`` if all values are null. It requires PostgreSQL 14+.
  58. ``BoolAnd``
  59. -----------
  60. .. class:: BoolAnd(expression, filter=None, default=None, **extra)
  61. Returns ``True``, if all input values are true, ``default`` if all values
  62. are null or if there are no values, otherwise ``False``.
  63. Usage example::
  64. class Comment(models.Model):
  65. body = models.TextField()
  66. published = models.BooleanField()
  67. rank = models.IntegerField()
  68. >>> from django.db.models import Q
  69. >>> from django.contrib.postgres.aggregates import BoolAnd
  70. >>> Comment.objects.aggregate(booland=BoolAnd('published'))
  71. {'booland': False}
  72. >>> Comment.objects.aggregate(booland=BoolAnd(Q(rank__lt=100)))
  73. {'booland': True}
  74. ``BoolOr``
  75. ----------
  76. .. class:: BoolOr(expression, filter=None, default=None, **extra)
  77. Returns ``True`` if at least one input value is true, ``default`` if all
  78. values are null or if there are no values, otherwise ``False``.
  79. Usage example::
  80. class Comment(models.Model):
  81. body = models.TextField()
  82. published = models.BooleanField()
  83. rank = models.IntegerField()
  84. >>> from django.db.models import Q
  85. >>> from django.contrib.postgres.aggregates import BoolOr
  86. >>> Comment.objects.aggregate(boolor=BoolOr('published'))
  87. {'boolor': True}
  88. >>> Comment.objects.aggregate(boolor=BoolOr(Q(rank__gt=2)))
  89. {'boolor': False}
  90. ``JSONBAgg``
  91. ------------
  92. .. class:: JSONBAgg(expressions, distinct=False, filter=None, default=None, ordering=(), **extra)
  93. Returns the input values as a ``JSON`` array, or ``default`` if there are
  94. no values. You can query the result using :lookup:`key and index lookups
  95. <jsonfield.key>`.
  96. .. attribute:: distinct
  97. An optional boolean argument that determines if array values will be
  98. distinct. Defaults to ``False``.
  99. .. attribute:: ordering
  100. An optional string of a field name (with an optional ``"-"`` prefix
  101. which indicates descending order) or an expression (or a tuple or list
  102. of strings and/or expressions) that specifies the ordering of the
  103. elements in the result list.
  104. Examples are the same as for :attr:`ArrayAgg.ordering`.
  105. Usage example::
  106. class Room(models.Model):
  107. number = models.IntegerField(unique=True)
  108. class HotelReservation(model.Model):
  109. room = models.ForeignKey('Room', on_delete=models.CASCADE)
  110. start = models.DateTimeField()
  111. end = models.DateTimeField()
  112. requirements = models.JSONField(blank=True, null=True)
  113. >>> from django.contrib.postgres.aggregates import JSONBAgg
  114. >>> Room.objects.annotate(
  115. ... requirements=JSONBAgg(
  116. ... 'hotelreservation__requirements',
  117. ... ordering='-hotelreservation__start',
  118. ... )
  119. ... ).filter(requirements__0__sea_view=True).values('number', 'requirements')
  120. <QuerySet [{'number': 102, 'requirements': [
  121. {'parking': False, 'sea_view': True, 'double_bed': False},
  122. {'parking': True, 'double_bed': True}
  123. ]}]>
  124. .. deprecated:: 4.0
  125. If there are no rows and ``default`` is not provided, ``JSONBAgg``
  126. returns an empty list instead of ``None``. This behavior is deprecated
  127. and will be removed in Django 5.0. If you need it, explicitly set
  128. ``default`` to ``Value('[]')``.
  129. ``StringAgg``
  130. -------------
  131. .. class:: StringAgg(expression, delimiter, distinct=False, filter=None, default=None, ordering=())
  132. Returns the input values concatenated into a string, separated by
  133. the ``delimiter`` string, or ``default`` if there are no values.
  134. .. attribute:: delimiter
  135. Required argument. Needs to be a string.
  136. .. attribute:: distinct
  137. An optional boolean argument that determines if concatenated values
  138. will be distinct. Defaults to ``False``.
  139. .. attribute:: ordering
  140. An optional string of a field name (with an optional ``"-"`` prefix
  141. which indicates descending order) or an expression (or a tuple or list
  142. of strings and/or expressions) that specifies the ordering of the
  143. elements in the result string.
  144. Examples are the same as for :attr:`ArrayAgg.ordering`.
  145. .. deprecated:: 4.0
  146. If there are no rows and ``default`` is not provided, ``StringAgg``
  147. returns an empty string instead of ``None``. This behavior is
  148. deprecated and will be removed in Django 5.0. If you need it,
  149. explicitly set ``default`` to ``Value('')``.
  150. Aggregate functions for statistics
  151. ==================================
  152. ``y`` and ``x``
  153. ---------------
  154. The arguments ``y`` and ``x`` for all these functions can be the name of a
  155. field or an expression returning a numeric data. Both are required.
  156. ``Corr``
  157. --------
  158. .. class:: Corr(y, x, filter=None, default=None)
  159. Returns the correlation coefficient as a ``float``, or ``default`` if there
  160. aren't any matching rows.
  161. ``CovarPop``
  162. ------------
  163. .. class:: CovarPop(y, x, sample=False, filter=None, default=None)
  164. Returns the population covariance as a ``float``, or ``default`` if there
  165. aren't any matching rows.
  166. .. attribute:: sample
  167. Optional. By default ``CovarPop`` returns the general population
  168. covariance. However, if ``sample=True``, the return value will be the
  169. sample population covariance.
  170. ``RegrAvgX``
  171. ------------
  172. .. class:: RegrAvgX(y, x, filter=None, default=None)
  173. Returns the average of the independent variable (``sum(x)/N``) as a
  174. ``float``, or ``default`` if there aren't any matching rows.
  175. ``RegrAvgY``
  176. ------------
  177. .. class:: RegrAvgY(y, x, filter=None, default=None)
  178. Returns the average of the dependent variable (``sum(y)/N``) as a
  179. ``float``, or ``default`` if there aren't any matching rows.
  180. ``RegrCount``
  181. -------------
  182. .. class:: RegrCount(y, x, filter=None)
  183. Returns an ``int`` of the number of input rows in which both expressions
  184. are not null.
  185. .. note::
  186. The ``default`` argument is not supported.
  187. ``RegrIntercept``
  188. -----------------
  189. .. class:: RegrIntercept(y, x, filter=None, default=None)
  190. Returns the y-intercept of the least-squares-fit linear equation determined
  191. by the ``(x, y)`` pairs as a ``float``, or ``default`` if there aren't any
  192. matching rows.
  193. ``RegrR2``
  194. ----------
  195. .. class:: RegrR2(y, x, filter=None, default=None)
  196. Returns the square of the correlation coefficient as a ``float``, or
  197. ``default`` if there aren't any matching rows.
  198. ``RegrSlope``
  199. -------------
  200. .. class:: RegrSlope(y, x, filter=None, default=None)
  201. Returns the slope of the least-squares-fit linear equation determined
  202. by the ``(x, y)`` pairs as a ``float``, or ``default`` if there aren't any
  203. matching rows.
  204. ``RegrSXX``
  205. -----------
  206. .. class:: RegrSXX(y, x, filter=None, default=None)
  207. Returns ``sum(x^2) - sum(x)^2/N`` ("sum of squares" of the independent
  208. variable) as a ``float``, or ``default`` if there aren't any matching rows.
  209. ``RegrSXY``
  210. -----------
  211. .. class:: RegrSXY(y, x, filter=None, default=None)
  212. Returns ``sum(x*y) - sum(x) * sum(y)/N`` ("sum of products" of independent
  213. times dependent variable) as a ``float``, or ``default`` if there aren't
  214. any matching rows.
  215. ``RegrSYY``
  216. -----------
  217. .. class:: RegrSYY(y, x, filter=None, default=None)
  218. Returns ``sum(y^2) - sum(y)^2/N`` ("sum of squares" of the dependent
  219. variable) as a ``float``, or ``default`` if there aren't any matching rows.
  220. Usage examples
  221. ==============
  222. We will use this example table::
  223. | FIELD1 | FIELD2 | FIELD3 |
  224. |--------|--------|--------|
  225. | foo | 1 | 13 |
  226. | bar | 2 | (null) |
  227. | test | 3 | 13 |
  228. Here's some examples of some of the general-purpose aggregation functions::
  229. >>> TestModel.objects.aggregate(result=StringAgg('field1', delimiter=';'))
  230. {'result': 'foo;bar;test'}
  231. >>> TestModel.objects.aggregate(result=ArrayAgg('field2'))
  232. {'result': [1, 2, 3]}
  233. >>> TestModel.objects.aggregate(result=ArrayAgg('field1'))
  234. {'result': ['foo', 'bar', 'test']}
  235. The next example shows the usage of statistical aggregate functions. The
  236. underlying math will be not described (you can read about this, for example, at
  237. `wikipedia <https://en.wikipedia.org/wiki/Regression_analysis>`_)::
  238. >>> TestModel.objects.aggregate(count=RegrCount(y='field3', x='field2'))
  239. {'count': 2}
  240. >>> TestModel.objects.aggregate(avgx=RegrAvgX(y='field3', x='field2'),
  241. ... avgy=RegrAvgY(y='field3', x='field2'))
  242. {'avgx': 2, 'avgy': 13}