aggregates.txt 12 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379
  1. =========================================
  2. PostgreSQL specific aggregation functions
  3. =========================================
  4. .. module:: django.contrib.postgres.aggregates
  5. :synopsis: PostgreSQL specific aggregation functions
  6. These functions are available from the ``django.contrib.postgres.aggregates``
  7. module. They are described in more detail in the `PostgreSQL docs
  8. <https://www.postgresql.org/docs/current/functions-aggregate.html>`_.
  9. .. note::
  10. All functions come without default aliases, so you must explicitly provide
  11. one. For example:
  12. .. code-block:: pycon
  13. >>> SomeModel.objects.aggregate(arr=ArrayAgg("somefield"))
  14. {'arr': [0, 1, 2]}
  15. .. admonition:: Common aggregate options
  16. All aggregates have the :ref:`filter <aggregate-filter>` keyword argument
  17. and most also have the :ref:`default <aggregate-default>` keyword argument.
  18. General-purpose aggregation functions
  19. =====================================
  20. ``ArrayAgg``
  21. ------------
  22. .. class:: ArrayAgg(expression, distinct=False, filter=None, default=None, ordering=(), **extra)
  23. Returns a list of values, including nulls, concatenated into an array, or
  24. ``default`` if there are no values.
  25. .. attribute:: distinct
  26. An optional boolean argument that determines if array values
  27. will be distinct. Defaults to ``False``.
  28. .. attribute:: ordering
  29. An optional string of a field name (with an optional ``"-"`` prefix
  30. which indicates descending order) or an expression (or a tuple or list
  31. of strings and/or expressions) that specifies the ordering of the
  32. elements in the result list.
  33. Examples::
  34. "some_field"
  35. "-some_field"
  36. from django.db.models import F
  37. F("some_field").desc()
  38. ``BitAnd``
  39. ----------
  40. .. class:: BitAnd(expression, filter=None, default=None, **extra)
  41. Returns an ``int`` of the bitwise ``AND`` of all non-null input values, or
  42. ``default`` if all values are null.
  43. ``BitOr``
  44. ---------
  45. .. class:: BitOr(expression, filter=None, default=None, **extra)
  46. Returns an ``int`` of the bitwise ``OR`` of all non-null input values, or
  47. ``default`` if all values are null.
  48. ``BitXor``
  49. ----------
  50. .. class:: BitXor(expression, filter=None, default=None, **extra)
  51. Returns an ``int`` of the bitwise ``XOR`` of all non-null input values, or
  52. ``default`` if all values are null. It requires PostgreSQL 14+.
  53. ``BoolAnd``
  54. -----------
  55. .. class:: BoolAnd(expression, filter=None, default=None, **extra)
  56. Returns ``True``, if all input values are true, ``default`` if all values
  57. are null or if there are no values, otherwise ``False``.
  58. Usage example::
  59. class Comment(models.Model):
  60. body = models.TextField()
  61. published = models.BooleanField()
  62. rank = models.IntegerField()
  63. .. code-block:: pycon
  64. >>> from django.db.models import Q
  65. >>> from django.contrib.postgres.aggregates import BoolAnd
  66. >>> Comment.objects.aggregate(booland=BoolAnd("published"))
  67. {'booland': False}
  68. >>> Comment.objects.aggregate(booland=BoolAnd(Q(rank__lt=100)))
  69. {'booland': True}
  70. ``BoolOr``
  71. ----------
  72. .. class:: BoolOr(expression, filter=None, default=None, **extra)
  73. Returns ``True`` if at least one input value is true, ``default`` if all
  74. values are null or if there are no values, otherwise ``False``.
  75. Usage example::
  76. class Comment(models.Model):
  77. body = models.TextField()
  78. published = models.BooleanField()
  79. rank = models.IntegerField()
  80. .. code-block:: pycon
  81. >>> from django.db.models import Q
  82. >>> from django.contrib.postgres.aggregates import BoolOr
  83. >>> Comment.objects.aggregate(boolor=BoolOr("published"))
  84. {'boolor': True}
  85. >>> Comment.objects.aggregate(boolor=BoolOr(Q(rank__gt=2)))
  86. {'boolor': False}
  87. ``JSONBAgg``
  88. ------------
  89. .. class:: JSONBAgg(expressions, distinct=False, filter=None, default=None, ordering=(), **extra)
  90. Returns the input values as a ``JSON`` array, or ``default`` if there are
  91. no values. You can query the result using :lookup:`key and index lookups
  92. <jsonfield.key>`.
  93. .. attribute:: distinct
  94. An optional boolean argument that determines if array values will be
  95. distinct. Defaults to ``False``.
  96. .. attribute:: ordering
  97. An optional string of a field name (with an optional ``"-"`` prefix
  98. which indicates descending order) or an expression (or a tuple or list
  99. of strings and/or expressions) that specifies the ordering of the
  100. elements in the result list.
  101. Examples are the same as for :attr:`ArrayAgg.ordering`.
  102. Usage example::
  103. class Room(models.Model):
  104. number = models.IntegerField(unique=True)
  105. class HotelReservation(models.Model):
  106. room = models.ForeignKey("Room", on_delete=models.CASCADE)
  107. start = models.DateTimeField()
  108. end = models.DateTimeField()
  109. requirements = models.JSONField(blank=True, null=True)
  110. .. code-block:: pycon
  111. >>> from django.contrib.postgres.aggregates import JSONBAgg
  112. >>> Room.objects.annotate(
  113. ... requirements=JSONBAgg(
  114. ... "hotelreservation__requirements",
  115. ... ordering="-hotelreservation__start",
  116. ... )
  117. ... ).filter(requirements__0__sea_view=True).values("number", "requirements")
  118. <QuerySet [{'number': 102, 'requirements': [
  119. {'parking': False, 'sea_view': True, 'double_bed': False},
  120. {'parking': True, 'double_bed': True}
  121. ]}]>
  122. ``StringAgg``
  123. -------------
  124. .. class:: StringAgg(expression, delimiter, distinct=False, filter=None, default=None, ordering=())
  125. Returns the input values concatenated into a string, separated by
  126. the ``delimiter`` string, or ``default`` if there are no values.
  127. .. attribute:: delimiter
  128. Required argument. Needs to be a string.
  129. .. attribute:: distinct
  130. An optional boolean argument that determines if concatenated values
  131. will be distinct. Defaults to ``False``.
  132. .. attribute:: ordering
  133. An optional string of a field name (with an optional ``"-"`` prefix
  134. which indicates descending order) or an expression (or a tuple or list
  135. of strings and/or expressions) that specifies the ordering of the
  136. elements in the result string.
  137. Examples are the same as for :attr:`ArrayAgg.ordering`.
  138. Usage example::
  139. class Publication(models.Model):
  140. title = models.CharField(max_length=30)
  141. class Article(models.Model):
  142. headline = models.CharField(max_length=100)
  143. publications = models.ManyToManyField(Publication)
  144. .. code-block:: pycon
  145. >>> article = Article.objects.create(headline="NASA uses Python")
  146. >>> article.publications.create(title="The Python Journal")
  147. <Publication: Publication object (1)>
  148. >>> article.publications.create(title="Science News")
  149. <Publication: Publication object (2)>
  150. >>> from django.contrib.postgres.aggregates import StringAgg
  151. >>> Article.objects.annotate(
  152. ... publication_names=StringAgg(
  153. ... "publications__title",
  154. ... delimiter=", ",
  155. ... ordering="publications__title",
  156. ... )
  157. ... ).values("headline", "publication_names")
  158. <QuerySet [{
  159. 'headline': 'NASA uses Python', 'publication_names': 'Science News, The Python Journal'
  160. }]>
  161. Aggregate functions for statistics
  162. ==================================
  163. ``y`` and ``x``
  164. ---------------
  165. The arguments ``y`` and ``x`` for all these functions can be the name of a
  166. field or an expression returning a numeric data. Both are required.
  167. ``Corr``
  168. --------
  169. .. class:: Corr(y, x, filter=None, default=None)
  170. Returns the correlation coefficient as a ``float``, or ``default`` if there
  171. aren't any matching rows.
  172. ``CovarPop``
  173. ------------
  174. .. class:: CovarPop(y, x, sample=False, filter=None, default=None)
  175. Returns the population covariance as a ``float``, or ``default`` if there
  176. aren't any matching rows.
  177. .. attribute:: sample
  178. Optional. By default ``CovarPop`` returns the general population
  179. covariance. However, if ``sample=True``, the return value will be the
  180. sample population covariance.
  181. ``RegrAvgX``
  182. ------------
  183. .. class:: RegrAvgX(y, x, filter=None, default=None)
  184. Returns the average of the independent variable (``sum(x)/N``) as a
  185. ``float``, or ``default`` if there aren't any matching rows.
  186. ``RegrAvgY``
  187. ------------
  188. .. class:: RegrAvgY(y, x, filter=None, default=None)
  189. Returns the average of the dependent variable (``sum(y)/N``) as a
  190. ``float``, or ``default`` if there aren't any matching rows.
  191. ``RegrCount``
  192. -------------
  193. .. class:: RegrCount(y, x, filter=None)
  194. Returns an ``int`` of the number of input rows in which both expressions
  195. are not null.
  196. .. note::
  197. The ``default`` argument is not supported.
  198. ``RegrIntercept``
  199. -----------------
  200. .. class:: RegrIntercept(y, x, filter=None, default=None)
  201. Returns the y-intercept of the least-squares-fit linear equation determined
  202. by the ``(x, y)`` pairs as a ``float``, or ``default`` if there aren't any
  203. matching rows.
  204. ``RegrR2``
  205. ----------
  206. .. class:: RegrR2(y, x, filter=None, default=None)
  207. Returns the square of the correlation coefficient as a ``float``, or
  208. ``default`` if there aren't any matching rows.
  209. ``RegrSlope``
  210. -------------
  211. .. class:: RegrSlope(y, x, filter=None, default=None)
  212. Returns the slope of the least-squares-fit linear equation determined
  213. by the ``(x, y)`` pairs as a ``float``, or ``default`` if there aren't any
  214. matching rows.
  215. ``RegrSXX``
  216. -----------
  217. .. class:: RegrSXX(y, x, filter=None, default=None)
  218. Returns ``sum(x^2) - sum(x)^2/N`` ("sum of squares" of the independent
  219. variable) as a ``float``, or ``default`` if there aren't any matching rows.
  220. ``RegrSXY``
  221. -----------
  222. .. class:: RegrSXY(y, x, filter=None, default=None)
  223. Returns ``sum(x*y) - sum(x) * sum(y)/N`` ("sum of products" of independent
  224. times dependent variable) as a ``float``, or ``default`` if there aren't
  225. any matching rows.
  226. ``RegrSYY``
  227. -----------
  228. .. class:: RegrSYY(y, x, filter=None, default=None)
  229. Returns ``sum(y^2) - sum(y)^2/N`` ("sum of squares" of the dependent
  230. variable) as a ``float``, or ``default`` if there aren't any matching rows.
  231. Usage examples
  232. ==============
  233. We will use this example table:
  234. .. code-block:: text
  235. | FIELD1 | FIELD2 | FIELD3 |
  236. |--------|--------|--------|
  237. | foo | 1 | 13 |
  238. | bar | 2 | (null) |
  239. | test | 3 | 13 |
  240. Here's some examples of some of the general-purpose aggregation functions:
  241. .. code-block:: pycon
  242. >>> TestModel.objects.aggregate(result=StringAgg("field1", delimiter=";"))
  243. {'result': 'foo;bar;test'}
  244. >>> TestModel.objects.aggregate(result=ArrayAgg("field2"))
  245. {'result': [1, 2, 3]}
  246. >>> TestModel.objects.aggregate(result=ArrayAgg("field1"))
  247. {'result': ['foo', 'bar', 'test']}
  248. The next example shows the usage of statistical aggregate functions. The
  249. underlying math will be not described (you can read about this, for example, at
  250. `wikipedia <https://en.wikipedia.org/wiki/Regression_analysis>`_):
  251. .. code-block:: pycon
  252. >>> TestModel.objects.aggregate(count=RegrCount(y="field3", x="field2"))
  253. {'count': 2}
  254. >>> TestModel.objects.aggregate(
  255. ... avgx=RegrAvgX(y="field3", x="field2"), avgy=RegrAvgY(y="field3", x="field2")
  256. ... )
  257. {'avgx': 2, 'avgy': 13}