databases.txt 33 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834
  1. =========
  2. Databases
  3. =========
  4. Django attempts to support as many features as possible on all database
  5. backends. However, not all database backends are alike, and we've had to make
  6. design decisions on which features to support and which assumptions we can make
  7. safely.
  8. This file describes some of the features that might be relevant to Django
  9. usage. Of course, it is not intended as a replacement for server-specific
  10. documentation or reference manuals.
  11. General notes
  12. =============
  13. .. _persistent-database-connections:
  14. Persistent connections
  15. ----------------------
  16. Persistent connections avoid the overhead of re-establishing a connection to
  17. the database in each request. They're controlled by the
  18. :setting:`CONN_MAX_AGE` parameter which defines the maximum lifetime of a
  19. connection. It can be set independently for each database.
  20. The default value is ``0``, preserving the historical behavior of closing the
  21. database connection at the end of each request. To enable persistent
  22. connections, set :setting:`CONN_MAX_AGE` to a positive number of seconds. For
  23. unlimited persistent connections, set it to ``None``.
  24. Connection management
  25. ~~~~~~~~~~~~~~~~~~~~~
  26. Django opens a connection to the database when it first makes a database
  27. query. It keeps this connection open and reuses it in subsequent requests.
  28. Django closes the connection once it exceeds the maximum age defined by
  29. :setting:`CONN_MAX_AGE` or when it isn't usable any longer.
  30. In detail, Django automatically opens a connection to the database whenever it
  31. needs one and doesn't have one already — either because this is the first
  32. connection, or because the previous connection was closed.
  33. At the beginning of each request, Django closes the connection if it has
  34. reached its maximum age. If your database terminates idle connections after
  35. some time, you should set :setting:`CONN_MAX_AGE` to a lower value, so that
  36. Django doesn't attempt to use a connection that has been terminated by the
  37. database server. (This problem may only affect very low traffic sites.)
  38. At the end of each request, Django closes the connection if it has reached its
  39. maximum age or if it is in an unrecoverable error state. If any database
  40. errors have occurred while processing the requests, Django checks whether the
  41. connection still works, and closes it if it doesn't. Thus, database errors
  42. affect at most one request; if the connection becomes unusable, the next
  43. request gets a fresh connection.
  44. Caveats
  45. ~~~~~~~
  46. Since each thread maintains its own connection, your database must support at
  47. least as many simultaneous connections as you have worker threads.
  48. Sometimes a database won't be accessed by the majority of your views, for
  49. example because it's the database of an external system, or thanks to caching.
  50. In such cases, you should set :setting:`CONN_MAX_AGE` to a low value or even
  51. ``0``, because it doesn't make sense to maintain a connection that's unlikely
  52. to be reused. This will help keep the number of simultaneous connections to
  53. this database small.
  54. The development server creates a new thread for each request it handles,
  55. negating the effect of persistent connections. Don't enable them during
  56. development.
  57. When Django establishes a connection to the database, it sets up appropriate
  58. parameters, depending on the backend being used. If you enable persistent
  59. connections, this setup is no longer repeated every request. If you modify
  60. parameters such as the connection's isolation level or time zone, you should
  61. either restore Django's defaults at the end of each request, force an
  62. appropriate value at the beginning of each request, or disable persistent
  63. connections.
  64. Encoding
  65. --------
  66. Django assumes that all databases use UTF-8 encoding. Using other encodings may
  67. result in unexpected behavior such as "value too long" errors from your
  68. database for data that is valid in Django. See the database specific notes
  69. below for information on how to set up your database correctly.
  70. .. _postgresql-notes:
  71. PostgreSQL notes
  72. ================
  73. Django supports PostgreSQL 9.0 and higher.
  74. PostgreSQL connection settings
  75. -------------------------------
  76. See :setting:`HOST` for details.
  77. Optimizing PostgreSQL's configuration
  78. -------------------------------------
  79. Django needs the following parameters for its database connections:
  80. - ``client_encoding``: ``'UTF8'``,
  81. - ``default_transaction_isolation``: ``'read committed'`` by default,
  82. or the value set in the connection options (see below),
  83. - ``timezone``: ``'UTC'`` when :setting:`USE_TZ` is ``True``, value of
  84. :setting:`TIME_ZONE` otherwise.
  85. If these parameters already have the correct values, Django won't set them for
  86. every new connection, which improves performance slightly. You can configure
  87. them directly in :file:`postgresql.conf` or more conveniently per database
  88. user with `ALTER ROLE`_.
  89. Django will work just fine without this optimization, but each new connection
  90. will do some additional queries to set these parameters.
  91. .. _ALTER ROLE: http://www.postgresql.org/docs/current/interactive/sql-alterrole.html
  92. .. _database-isolation-level:
  93. Isolation level
  94. ---------------
  95. Like PostgreSQL itself, Django defaults to the ``READ COMMITTED`` `isolation
  96. level`_. If you need a higher isolation level such as ``REPEATABLE READ`` or
  97. ``SERIALIZABLE``, set it in the :setting:`OPTIONS` part of your database
  98. configuration in :setting:`DATABASES`::
  99. import psycopg2.extensions
  100. DATABASES = {
  101. # ...
  102. 'OPTIONS': {
  103. 'isolation_level': psycopg2.extensions.ISOLATION_LEVEL_SERIALIZABLE,
  104. },
  105. }
  106. .. note::
  107. Under higher isolation levels, your application should be prepared to
  108. handle exceptions raised on serialization failures. This option is
  109. designed for advanced uses.
  110. .. _isolation level: http://www.postgresql.org/docs/current/static/transaction-iso.html
  111. Indexes for ``varchar`` and ``text`` columns
  112. --------------------------------------------
  113. When specifying ``db_index=True`` on your model fields, Django typically
  114. outputs a single ``CREATE INDEX`` statement. However, if the database type
  115. for the field is either ``varchar`` or ``text`` (e.g., used by ``CharField``,
  116. ``FileField``, and ``TextField``), then Django will create
  117. an additional index that uses an appropriate `PostgreSQL operator class`_
  118. for the column. The extra index is necessary to correctly perform
  119. lookups that use the ``LIKE`` operator in their SQL, as is done with the
  120. ``contains`` and ``startswith`` lookup types.
  121. .. _PostgreSQL operator class: http://www.postgresql.org/docs/current/static/indexes-opclass.html
  122. .. _mysql-notes:
  123. MySQL notes
  124. ===========
  125. Version support
  126. ---------------
  127. Django supports MySQL 5.5 and higher.
  128. Django's ``inspectdb`` feature uses the ``information_schema`` database, which
  129. contains detailed data on all database schemas.
  130. Django expects the database to support Unicode (UTF-8 encoding) and delegates to
  131. it the task of enforcing transactions and referential integrity. It is important
  132. to be aware of the fact that the two latter ones aren't actually enforced by
  133. MySQL when using the MyISAM storage engine, see the next section.
  134. .. _mysql-storage-engines:
  135. Storage engines
  136. ---------------
  137. MySQL has several `storage engines`_. You can change the default storage engine
  138. in the server configuration.
  139. Until MySQL 5.5.4, the default engine was MyISAM_ [#]_. The main drawbacks of
  140. MyISAM are that it doesn't support transactions or enforce foreign-key
  141. constraints. On the plus side, it was the only engine that supported full-text
  142. indexing and searching until MySQL 5.6.4.
  143. Since MySQL 5.5.5, the default storage engine is InnoDB_. This engine is fully
  144. transactional and supports foreign key references. It's probably the best
  145. choice at this point. However, note that the InnoDB autoincrement counter
  146. is lost on a MySQL restart because it does not remember the
  147. ``AUTO_INCREMENT`` value, instead recreating it as "max(id)+1". This may
  148. result in an inadvertent reuse of :class:`~django.db.models.AutoField` values.
  149. If you upgrade an existing project to MySQL 5.5.5 and subsequently add some
  150. tables, ensure that your tables are using the same storage engine (i.e. MyISAM
  151. vs. InnoDB). Specifically, if tables that have a ``ForeignKey`` between them
  152. use different storage engines, you may see an error like the following when
  153. running ``migrate``::
  154. _mysql_exceptions.OperationalError: (
  155. 1005, "Can't create table '\\db_name\\.#sql-4a8_ab' (errno: 150)"
  156. )
  157. .. _storage engines: http://dev.mysql.com/doc/refman/5.6/en/storage-engines.html
  158. .. _MyISAM: http://dev.mysql.com/doc/refman/5.6/en/myisam-storage-engine.html
  159. .. _InnoDB: http://dev.mysql.com/doc/refman/5.6/en/innodb-storage-engine.html
  160. .. [#] Unless this was changed by the packager of your MySQL package. We've
  161. had reports that the Windows Community Server installer sets up InnoDB as
  162. the default storage engine, for example.
  163. .. _mysql-db-api-drivers:
  164. MySQL DB API Drivers
  165. --------------------
  166. The Python Database API is described in `PEP 249`_. MySQL has two prominent
  167. drivers that implement this API:
  168. .. _PEP 249: http://www.python.org/dev/peps/pep-0249/
  169. - `MySQLdb`_ is a native driver that has been developed and supported for over
  170. a decade by Andy Dustman.
  171. - `MySQL Connector/Python`_ is a pure Python driver from Oracle that does not
  172. require the MySQL client library or any Python modules outside the standard
  173. library.
  174. .. _MySQLdb: https://pypi.python.org/pypi/MySQL-python/1.2.4
  175. .. _MySQL Connector/Python: http://dev.mysql.com/downloads/connector/python
  176. Both drivers are thread-safe and both provide connection pooling. The major
  177. difference is that MySQL Connector/Python supports Python 3.
  178. In addition to a DB API driver, Django needs an adapter to access the database
  179. drivers from its ORM. Django provides an adapter for MySQLdb while MySQL
  180. Connector/Python includes `its own`_.
  181. .. _its own: http://dev.mysql.com/doc/refman/5.6/en/connector-python-django-backend.html
  182. MySQLdb
  183. ~~~~~~~
  184. Django requires MySQLdb version 1.2.1p2 or later.
  185. .. note::
  186. If you see ``ImportError: cannot import name ImmutableSet`` when trying to
  187. use Django, your MySQLdb installation may contain an outdated ``sets.py``
  188. file that conflicts with the built-in module of the same name from Python
  189. 2.4 and later. To fix this, verify that you have installed MySQLdb version
  190. 1.2.1p2 or newer, then delete the ``sets.py`` file in the MySQLdb
  191. directory that was left by an earlier version.
  192. .. note::
  193. There are known issues with the way MySQLdb converts date strings into
  194. datetime objects. Specifically, date strings with value 0000-00-00 are
  195. valid for MySQL but will be converted into None by MySQLdb.
  196. This means you should be careful while using loaddata/dumpdata with rows
  197. that may have 0000-00-00 values, as they will be converted to None.
  198. .. note::
  199. At the time of writing, the latest release of MySQLdb (1.2.4) doesn't
  200. support Python 3. In order to use MySQLdb under Python 3, you'll have to
  201. install an unofficial fork, such as `MySQL-for-Python-3`_.
  202. This port is still in alpha. In particular, it doesn't support binary
  203. data, making it impossible to use :class:`django.db.models.BinaryField`.
  204. .. _MySQL-for-Python-3: https://github.com/clelland/MySQL-for-Python-3
  205. MySQL Connector/Python
  206. ~~~~~~~~~~~~~~~~~~~~~~
  207. MySQL Connector/Python is available from the `download page`_.
  208. The Django adapter is available in versions 1.1.X and later. It may not
  209. support the most recent releases of Django.
  210. .. _download page: http://dev.mysql.com/downloads/connector/python/
  211. .. _mysql-time-zone-definitions:
  212. Time zone definitions
  213. ---------------------
  214. If you plan on using Django's :doc:`timezone support </topics/i18n/timezones>`,
  215. use `mysql_tzinfo_to_sql`_ to load time zone tables into the MySQL database.
  216. This needs to be done just once for your MySQL server, not per database.
  217. .. _mysql_tzinfo_to_sql: http://dev.mysql.com/doc/refman/5.6/en/mysql-tzinfo-to-sql.html
  218. Creating your database
  219. ----------------------
  220. You can `create your database`_ using the command-line tools and this SQL::
  221. CREATE DATABASE <dbname> CHARACTER SET utf8;
  222. This ensures all tables and columns will use UTF-8 by default.
  223. .. _create your database: http://dev.mysql.com/doc/refman/5.6/en/create-database.html
  224. .. _mysql-collation:
  225. Collation settings
  226. ~~~~~~~~~~~~~~~~~~
  227. The collation setting for a column controls the order in which data is sorted
  228. as well as what strings compare as equal. It can be set on a database-wide
  229. level and also per-table and per-column. This is `documented thoroughly`_ in
  230. the MySQL documentation. In all cases, you set the collation by directly
  231. manipulating the database tables; Django doesn't provide a way to set this on
  232. the model definition.
  233. .. _documented thoroughly: http://dev.mysql.com/doc/refman/5.6/en/charset.html
  234. By default, with a UTF-8 database, MySQL will use the
  235. ``utf8_general_ci`` collation. This results in all string equality
  236. comparisons being done in a *case-insensitive* manner. That is, ``"Fred"`` and
  237. ``"freD"`` are considered equal at the database level. If you have a unique
  238. constraint on a field, it would be illegal to try to insert both ``"aa"`` and
  239. ``"AA"`` into the same column, since they compare as equal (and, hence,
  240. non-unique) with the default collation.
  241. In many cases, this default will not be a problem. However, if you really want
  242. case-sensitive comparisons on a particular column or table, you would change
  243. the column or table to use the ``utf8_bin`` collation. The main thing to be
  244. aware of in this case is that if you are using MySQLdb 1.2.2, the database
  245. backend in Django will then return bytestrings (instead of unicode strings) for
  246. any character fields it receive from the database. This is a strong variation
  247. from Django's normal practice of *always* returning unicode strings. It is up
  248. to you, the developer, to handle the fact that you will receive bytestrings if
  249. you configure your table(s) to use ``utf8_bin`` collation. Django itself should
  250. mostly work smoothly with such columns (except for the ``contrib.sessions``
  251. ``Session`` and ``contrib.admin`` ``LogEntry`` tables described below), but
  252. your code must be prepared to call ``django.utils.encoding.smart_text()`` at
  253. times if it really wants to work with consistent data -- Django will not do
  254. this for you (the database backend layer and the model population layer are
  255. separated internally so the database layer doesn't know it needs to make this
  256. conversion in this one particular case).
  257. If you're using MySQLdb 1.2.1p2, Django's standard
  258. :class:`~django.db.models.CharField` class will return unicode strings even
  259. with ``utf8_bin`` collation. However, :class:`~django.db.models.TextField`
  260. fields will be returned as an ``array.array`` instance (from Python's standard
  261. ``array`` module). There isn't a lot Django can do about that, since, again,
  262. the information needed to make the necessary conversions isn't available when
  263. the data is read in from the database. This problem was `fixed in MySQLdb
  264. 1.2.2`_, so if you want to use :class:`~django.db.models.TextField` with
  265. ``utf8_bin`` collation, upgrading to version 1.2.2 and then dealing with the
  266. bytestrings (which shouldn't be too difficult) as described above is the
  267. recommended solution.
  268. Should you decide to use ``utf8_bin`` collation for some of your tables with
  269. MySQLdb 1.2.1p2 or 1.2.2, you should still use ``utf8_general_ci``
  270. (the default) collation for the ``django.contrib.sessions.models.Session``
  271. table (usually called ``django_session``) and the
  272. ``django.contrib.admin.models.LogEntry`` table (usually called
  273. ``django_admin_log``). Those are the two standard tables that use
  274. :class:`~django.db.models.TextField` internally.
  275. .. _fixed in MySQLdb 1.2.2: http://sourceforge.net/tracker/index.php?func=detail&aid=1495765&group_id=22307&atid=374932
  276. Please note that according to `MySQL Unicode Character Sets`_, comparisons for
  277. the ``utf8_general_ci`` collation are faster, but slightly less correct, than
  278. comparisons for ``utf8_unicode_ci``. If this is acceptable for your application,
  279. you should use ``utf8_general_ci`` because it is faster. If this is not acceptable
  280. (for example, if you require German dictionary order), use ``utf8_unicode_ci``
  281. because it is more accurate.
  282. .. _MySQL Unicode Character Sets: http://dev.mysql.com/doc/refman/5.7/en/charset-unicode-sets.html
  283. Connecting to the database
  284. --------------------------
  285. Refer to the :doc:`settings documentation </ref/settings>`.
  286. Connection settings are used in this order:
  287. 1. :setting:`OPTIONS`.
  288. 2. :setting:`NAME`, :setting:`USER`, :setting:`PASSWORD`,
  289. :setting:`HOST`, :setting:`PORT`
  290. 3. MySQL option files.
  291. In other words, if you set the name of the database in :setting:`OPTIONS`,
  292. this will take precedence over :setting:`NAME`, which would override
  293. anything in a `MySQL option file`_.
  294. Here's a sample configuration which uses a MySQL option file::
  295. # settings.py
  296. DATABASES = {
  297. 'default': {
  298. 'ENGINE': 'django.db.backends.mysql',
  299. 'OPTIONS': {
  300. 'read_default_file': '/path/to/my.cnf',
  301. },
  302. }
  303. }
  304. # my.cnf
  305. [client]
  306. database = NAME
  307. user = USER
  308. password = PASSWORD
  309. default-character-set = utf8
  310. Several other MySQLdb connection options may be useful, such as ``ssl``,
  311. ``init_command``, and ``sql_mode``. Consult the `MySQLdb documentation`_ for
  312. more details.
  313. .. _MySQL option file: http://dev.mysql.com/doc/refman/5.6/en/option-files.html
  314. .. _MySQLdb documentation: http://mysql-python.sourceforge.net/
  315. Creating your tables
  316. --------------------
  317. When Django generates the schema, it doesn't specify a storage engine, so
  318. tables will be created with whatever default storage engine your database
  319. server is configured for. The easiest solution is to set your database server's
  320. default storage engine to the desired engine.
  321. If you're using a hosting service and can't change your server's default
  322. storage engine, you have a couple of options.
  323. * After the tables are created, execute an ``ALTER TABLE`` statement to
  324. convert a table to a new storage engine (such as InnoDB)::
  325. ALTER TABLE <tablename> ENGINE=INNODB;
  326. This can be tedious if you have a lot of tables.
  327. * Another option is to use the ``init_command`` option for MySQLdb prior to
  328. creating your tables::
  329. 'OPTIONS': {
  330. 'init_command': 'SET storage_engine=INNODB',
  331. }
  332. This sets the default storage engine upon connecting to the database.
  333. After your tables have been created, you should remove this option as it
  334. adds a query that is only needed during table creation to each database
  335. connection.
  336. Table names
  337. -----------
  338. There are `known issues`_ in even the latest versions of MySQL that can cause the
  339. case of a table name to be altered when certain SQL statements are executed
  340. under certain conditions. It is recommended that you use lowercase table
  341. names, if possible, to avoid any problems that might arise from this behavior.
  342. Django uses lowercase table names when it auto-generates table names from
  343. models, so this is mainly a consideration if you are overriding the table name
  344. via the :class:`~django.db.models.Options.db_table` parameter.
  345. .. _known issues: http://bugs.mysql.com/bug.php?id=48875
  346. Savepoints
  347. ----------
  348. Both the Django ORM and MySQL (when using the InnoDB :ref:`storage engine
  349. <mysql-storage-engines>`) support database :ref:`savepoints
  350. <topics-db-transactions-savepoints>`.
  351. If you use the MyISAM storage engine please be aware of the fact that you will
  352. receive database-generated errors if you try to use the :ref:`savepoint-related
  353. methods of the transactions API <topics-db-transactions-savepoints>`. The reason
  354. for this is that detecting the storage engine of a MySQL database/table is an
  355. expensive operation so it was decided it isn't worth to dynamically convert
  356. these methods in no-op's based in the results of such detection.
  357. Notes on specific fields
  358. ------------------------
  359. Character fields
  360. ~~~~~~~~~~~~~~~~
  361. Any fields that are stored with ``VARCHAR`` column types have their
  362. ``max_length`` restricted to 255 characters if you are using ``unique=True``
  363. for the field. This affects :class:`~django.db.models.CharField`,
  364. :class:`~django.db.models.SlugField` and
  365. :class:`~django.db.models.CommaSeparatedIntegerField`.
  366. DateTime fields
  367. ~~~~~~~~~~~~~~~
  368. MySQL does not have a timezone-aware column type. If an attempt is made to
  369. store a timezone-aware ``time`` or ``datetime`` to a
  370. :class:`~django.db.models.TimeField` or :class:`~django.db.models.DateTimeField`
  371. respectively, a ``ValueError`` is raised rather than truncating data.
  372. MySQL does not store fractions of seconds. Fractions of seconds are truncated
  373. to zero when the time is stored.
  374. Row locking with ``QuerySet.select_for_update()``
  375. -------------------------------------------------
  376. MySQL does not support the ``NOWAIT`` option to the ``SELECT ... FOR UPDATE``
  377. statement. If ``select_for_update()`` is used with ``nowait=True`` then a
  378. ``DatabaseError`` will be raised.
  379. Automatic typecasting can cause unexpected results
  380. --------------------------------------------------
  381. When performing a query on a string type, but with an integer value, MySQL will
  382. coerce the types of all values in the table to an integer before performing the
  383. comparison. If your table contains the values ``'abc'``, ``'def'`` and you
  384. query for ``WHERE mycolumn=0``, both rows will match. Similarly, ``WHERE mycolumn=1``
  385. will match the value ``'abc1'``. Therefore, string type fields included in Django
  386. will always cast the value to a string before using it in a query.
  387. If you implement custom model fields that inherit from :class:`~django.db.models.Field`
  388. directly, are overriding :meth:`~django.db.models.Field.get_prep_value`, or use
  389. :meth:`extra() <django.db.models.query.QuerySet.extra>` or
  390. :meth:`raw() <django.db.models.Manager.raw>`, you should ensure that you
  391. perform the appropriate typecasting.
  392. .. _sqlite-notes:
  393. SQLite notes
  394. ============
  395. SQLite_ provides an excellent development alternative for applications that
  396. are predominantly read-only or require a smaller installation footprint. As
  397. with all database servers, though, there are some differences that are
  398. specific to SQLite that you should be aware of.
  399. .. _SQLite: http://www.sqlite.org/
  400. .. _sqlite-string-matching:
  401. Substring matching and case sensitivity
  402. -----------------------------------------
  403. For all SQLite versions, there is some slightly counter-intuitive behavior when
  404. attempting to match some types of strings. These are triggered when using the
  405. :lookup:`iexact` or :lookup:`contains` filters in Querysets. The behavior
  406. splits into two cases:
  407. 1. For substring matching, all matches are done case-insensitively. That is a
  408. filter such as ``filter(name__contains="aa")`` will match a name of ``"Aabb"``.
  409. 2. For strings containing characters outside the ASCII range, all exact string
  410. matches are performed case-sensitively, even when the case-insensitive options
  411. are passed into the query. So the :lookup:`iexact` filter will behave exactly
  412. the same as the :lookup:`exact` filter in these cases.
  413. Some possible workarounds for this are `documented at sqlite.org`_, but they
  414. aren't utilized by the default SQLite backend in Django, as incorporating them
  415. would be fairly difficult to do robustly. Thus, Django exposes the default
  416. SQLite behavior and you should be aware of this when doing case-insensitive or
  417. substring filtering.
  418. .. _documented at sqlite.org: http://www.sqlite.org/faq.html#q18
  419. .. _using-newer-versions-of-pysqlite:
  420. Using newer versions of the SQLite DB-API 2.0 driver
  421. ----------------------------------------------------
  422. Django will use a ``pysqlite2`` module in preference to ``sqlite3`` as shipped
  423. with the Python standard library if it finds one is available.
  424. This provides the ability to upgrade both the DB-API 2.0 interface or SQLite 3
  425. itself to versions newer than the ones included with your particular Python
  426. binary distribution, if needed.
  427. "Database is locked" errors
  428. ---------------------------
  429. SQLite is meant to be a lightweight database, and thus can't support a high
  430. level of concurrency. ``OperationalError: database is locked`` errors indicate
  431. that your application is experiencing more concurrency than ``sqlite`` can
  432. handle in default configuration. This error means that one thread or process has
  433. an exclusive lock on the database connection and another thread timed out
  434. waiting for the lock the be released.
  435. Python's SQLite wrapper has
  436. a default timeout value that determines how long the second thread is allowed to
  437. wait on the lock before it times out and raises the ``OperationalError: database
  438. is locked`` error.
  439. If you're getting this error, you can solve it by:
  440. * Switching to another database backend. At a certain point SQLite becomes
  441. too "lite" for real-world applications, and these sorts of concurrency
  442. errors indicate you've reached that point.
  443. * Rewriting your code to reduce concurrency and ensure that database
  444. transactions are short-lived.
  445. * Increase the default timeout value by setting the ``timeout`` database
  446. option option::
  447. 'OPTIONS': {
  448. # ...
  449. 'timeout': 20,
  450. # ...
  451. }
  452. This will simply make SQLite wait a bit longer before throwing "database
  453. is locked" errors; it won't really do anything to solve them.
  454. ``QuerySet.select_for_update()`` not supported
  455. ----------------------------------------------
  456. SQLite does not support the ``SELECT ... FOR UPDATE`` syntax. Calling it will
  457. have no effect.
  458. "pyformat" parameter style in raw queries not supported
  459. -------------------------------------------------------
  460. For most backends, raw queries (``Manager.raw()`` or ``cursor.execute()``)
  461. can use the "pyformat" parameter style, where placeholders in the query
  462. are given as ``'%(name)s'`` and the parameters are passed as a dictionary
  463. rather than a list. SQLite does not support this.
  464. .. _sqlite-connection-queries:
  465. Parameters not quoted in ``connection.queries``
  466. -----------------------------------------------
  467. ``sqlite3`` does not provide a way to retrieve the SQL after quoting and
  468. substituting the parameters. Instead, the SQL in ``connection.queries`` is
  469. rebuilt with a simple string interpolation. It may be incorrect. Make sure
  470. you add quotes where necessary before copying a query into an SQLite shell.
  471. .. _oracle-notes:
  472. Oracle notes
  473. ============
  474. Django supports `Oracle Database Server`_ versions 11.1 and higher. Version
  475. 4.3.1 or higher of the `cx_Oracle`_ Python driver is required, although we
  476. recommend version 5.1.3 or later as these versions support Python 3.
  477. Note that due to a Unicode-corruption bug in ``cx_Oracle`` 5.0, that
  478. version of the driver should **not** be used with Django;
  479. ``cx_Oracle`` 5.0.1 resolved this issue, so if you'd like to use a
  480. more recent ``cx_Oracle``, use version 5.0.1.
  481. ``cx_Oracle`` 5.0.1 or greater can optionally be compiled with the
  482. ``WITH_UNICODE`` environment variable. This is recommended but not
  483. required.
  484. .. _`Oracle Database Server`: http://www.oracle.com/
  485. .. _`cx_Oracle`: http://cx-oracle.sourceforge.net/
  486. In order for the ``python manage.py migrate`` command to work, your Oracle
  487. database user must have privileges to run the following commands:
  488. * CREATE TABLE
  489. * CREATE SEQUENCE
  490. * CREATE PROCEDURE
  491. * CREATE TRIGGER
  492. To run Django's test suite, the user needs these *additional* privileges:
  493. * CREATE USER
  494. * DROP USER
  495. * CREATE TABLESPACE
  496. * DROP TABLESPACE
  497. * CONNECT WITH ADMIN OPTION
  498. * RESOURCE WITH ADMIN OPTION
  499. The Oracle database backend uses the ``SYS.DBMS_LOB`` package, so your user
  500. will require execute permissions on it. It's normally accessible to all users
  501. by default, but in case it is not, you'll need to grant permissions like so:
  502. .. code-block:: sql
  503. GRANT EXECUTE ON SYS.DBMS_LOB TO user;
  504. Connecting to the database
  505. --------------------------
  506. To connect using the service name of your Oracle database, your ``settings.py``
  507. file should look something like this::
  508. DATABASES = {
  509. 'default': {
  510. 'ENGINE': 'django.db.backends.oracle',
  511. 'NAME': 'xe',
  512. 'USER': 'a_user',
  513. 'PASSWORD': 'a_password',
  514. 'HOST': '',
  515. 'PORT': '',
  516. }
  517. }
  518. In this case, you should leave both :setting:`HOST` and :setting:`PORT` empty.
  519. However, if you don't use a ``tnsnames.ora`` file or a similar naming method
  520. and want to connect using the SID ("xe" in this example), then fill in both
  521. :setting:`HOST` and :setting:`PORT` like so::
  522. DATABASES = {
  523. 'default': {
  524. 'ENGINE': 'django.db.backends.oracle',
  525. 'NAME': 'xe',
  526. 'USER': 'a_user',
  527. 'PASSWORD': 'a_password',
  528. 'HOST': 'dbprod01ned.mycompany.com',
  529. 'PORT': '1540',
  530. }
  531. }
  532. You should either supply both :setting:`HOST` and :setting:`PORT`, or leave
  533. both as empty strings. Django will use a different connect descriptor depending
  534. on that choice.
  535. Threaded option
  536. ----------------
  537. If you plan to run Django in a multithreaded environment (e.g. Apache using the
  538. default MPM module on any modern operating system), then you **must** set
  539. the ``threaded`` option of your Oracle database configuration to True::
  540. 'OPTIONS': {
  541. 'threaded': True,
  542. },
  543. Failure to do this may result in crashes and other odd behavior.
  544. INSERT ... RETURNING INTO
  545. -------------------------
  546. By default, the Oracle backend uses a ``RETURNING INTO`` clause to efficiently
  547. retrieve the value of an ``AutoField`` when inserting new rows. This behavior
  548. may result in a ``DatabaseError`` in certain unusual setups, such as when
  549. inserting into a remote table, or into a view with an ``INSTEAD OF`` trigger.
  550. The ``RETURNING INTO`` clause can be disabled by setting the
  551. ``use_returning_into`` option of the database configuration to False::
  552. 'OPTIONS': {
  553. 'use_returning_into': False,
  554. },
  555. In this case, the Oracle backend will use a separate ``SELECT`` query to
  556. retrieve AutoField values.
  557. Naming issues
  558. -------------
  559. Oracle imposes a name length limit of 30 characters. To accommodate this, the
  560. backend truncates database identifiers to fit, replacing the final four
  561. characters of the truncated name with a repeatable MD5 hash value.
  562. Additionally, the backend turns database identifiers to all-uppercase.
  563. To prevent these transformations (this is usually required only when dealing
  564. with legacy databases or accessing tables which belong to other users), use
  565. a quoted name as the value for ``db_table``::
  566. class LegacyModel(models.Model):
  567. class Meta:
  568. db_table = '"name_left_in_lowercase"'
  569. class ForeignModel(models.Model):
  570. class Meta:
  571. db_table = '"OTHER_USER"."NAME_ONLY_SEEMS_OVER_30"'
  572. Quoted names can also be used with Django's other supported database
  573. backends; except for Oracle, however, the quotes have no effect.
  574. When running ``migrate``, an ``ORA-06552`` error may be encountered if
  575. certain Oracle keywords are used as the name of a model field or the
  576. value of a ``db_column`` option. Django quotes all identifiers used
  577. in queries to prevent most such problems, but this error can still
  578. occur when an Oracle datatype is used as a column name. In
  579. particular, take care to avoid using the names ``date``,
  580. ``timestamp``, ``number`` or ``float`` as a field name.
  581. NULL and empty strings
  582. ----------------------
  583. Django generally prefers to use the empty string ('') rather than
  584. NULL, but Oracle treats both identically. To get around this, the
  585. Oracle backend ignores an explicit ``null`` option on fields that
  586. have the empty string as a possible value and generates DDL as if
  587. ``null=True``. When fetching from the database, it is assumed that
  588. a ``NULL`` value in one of these fields really means the empty
  589. string, and the data is silently converted to reflect this assumption.
  590. ``TextField`` limitations
  591. -------------------------
  592. The Oracle backend stores ``TextFields`` as ``NCLOB`` columns. Oracle imposes
  593. some limitations on the usage of such LOB columns in general:
  594. * LOB columns may not be used as primary keys.
  595. * LOB columns may not be used in indexes.
  596. * LOB columns may not be used in a ``SELECT DISTINCT`` list. This means that
  597. attempting to use the ``QuerySet.distinct`` method on a model that
  598. includes ``TextField`` columns will result in an error when run against
  599. Oracle. As a workaround, use the ``QuerySet.defer`` method in conjunction
  600. with ``distinct()`` to prevent ``TextField`` columns from being included in
  601. the ``SELECT DISTINCT`` list.
  602. .. _third-party-notes:
  603. Using a 3rd-party database backend
  604. ==================================
  605. In addition to the officially supported databases, there are backends provided
  606. by 3rd parties that allow you to use other databases with Django:
  607. * `SAP SQL Anywhere`_
  608. * `IBM DB2`_
  609. * `Microsoft SQL Server`_
  610. * Firebird_
  611. * ODBC_
  612. * ADSDB_
  613. The Django versions and ORM features supported by these unofficial backends
  614. vary considerably. Queries regarding the specific capabilities of these
  615. unofficial backends, along with any support queries, should be directed to
  616. the support channels provided by each 3rd party project.
  617. .. _SAP SQL Anywhere: https://github.com/sqlanywhere/sqlany-django
  618. .. _IBM DB2: http://code.google.com/p/ibm-db/
  619. .. _Microsoft SQL Server: http://django-mssql.readthedocs.org/en/latest/
  620. .. _Firebird: https://github.com/maxirobaina/django-firebird
  621. .. _ODBC: https://github.com/lionheart/django-pyodbc/
  622. .. _ADSDB: http://code.google.com/p/adsdb-django/