migrations.txt 33 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814
  1. ==========
  2. Migrations
  3. ==========
  4. .. module:: django.db.migrations
  5. :synopsis: Schema migration support for Django models
  6. .. versionadded:: 1.7
  7. Migrations are Django's way of propagating changes you make to your models
  8. (adding a field, deleting a model, etc.) into your database schema. They're
  9. designed to be mostly automatic, but you'll need to know when to make
  10. migrations, when to run them, and the common problems you might run into.
  11. The Commands
  12. ------------
  13. There are several commands which you will use to interact with migrations
  14. and Django's handling of database schema:
  15. * :djadmin:`migrate`, which is responsible for applying migrations, as well as
  16. unapplying and listing their status.
  17. * :djadmin:`makemigrations`, which is responsible for creating new migrations
  18. based on the changes you have made to your models.
  19. * :djadmin:`sqlmigrate`, which displays the SQL statements for a migration.
  20. It's worth noting that migrations are created and run on a per-app basis.
  21. In particular, it's possible to have apps that *do not use migrations* (these
  22. are referred to as "unmigrated" apps) - these apps will instead mimic the
  23. legacy behavior of just adding new models.
  24. You should think of migrations as a version control system for your database
  25. schema. ``makemigrations`` is responsible for packaging up your model changes
  26. into individual migration files - analogous to commits - and ``migrate`` is
  27. responsible for applying those to your database.
  28. The migration files for each app live in a "migrations" directory inside
  29. of that app, and are designed to be committed to, and distributed as part
  30. of, its codebase. You should be making them once on your development machine
  31. and then running the same migrations on your colleagues' machines, your
  32. staging machines, and eventually your production machines.
  33. .. note::
  34. It is possible to override the name of the package which contains the
  35. migrations on a per-app basis by modifying the :setting:`MIGRATION_MODULES`
  36. setting.
  37. Migrations will run the same way on the same dataset and produce consistent
  38. results, meaning that what you see in development and staging is, under the
  39. same circumstances, exactly what will happen in production.
  40. Django will make migrations for any change to your models or fields - even
  41. options that don't affect the database - as the only way it can reconstruct
  42. a field correctly is to have all the changes in the history, and you might
  43. need those options in some data migrations later on (for example, if you've
  44. set custom validators).
  45. Backend Support
  46. ---------------
  47. Migrations are supported on all backends that Django ships with, as well
  48. as any third-party backends if they have programmed in support for schema
  49. alteration (done via the :doc:`SchemaEditor </ref/schema-editor>` class).
  50. However, some databases are more capable than others when it comes to
  51. schema migrations; some of the caveats are covered below.
  52. PostgreSQL
  53. ~~~~~~~~~~
  54. PostgreSQL is the most capable of all the databases here in terms of schema
  55. support; the only caveat is that adding columns with default values will
  56. cause a full rewrite of the table, for a time proportional to its size.
  57. For this reason, it's recommended you always create new columns with
  58. ``null=True``, as this way they will be added immediately.
  59. MySQL
  60. ~~~~~
  61. MySQL lacks support for transactions around schema alteration operations,
  62. meaning that if a migration fails to apply you will have to manually unpick
  63. the changes in order to try again (it's impossible to roll back to an
  64. earlier point).
  65. In addition, MySQL will fully rewrite tables for almost every schema operation
  66. and generally takes a time proportional to the number of rows in the table to
  67. add or remove columns. On slower hardware this can be worse than a minute per
  68. million rows - adding a few columns to a table with just a few million rows
  69. could lock your site up for over ten minutes.
  70. Finally, MySQL has reasonably small limits on name lengths for columns, tables
  71. and indexes, as well as a limit on the combined size of all columns an index
  72. covers. This means that indexes that are possible on other backends will
  73. fail to be created under MySQL.
  74. SQLite
  75. ~~~~~~
  76. SQLite has very little built-in schema alteration support, and so Django
  77. attempts to emulate it by:
  78. * Creating a new table with the new schema
  79. * Copying the data across
  80. * Dropping the old table
  81. * Renaming the new table to match the original name
  82. This process generally works well, but it can be slow and occasionally
  83. buggy. It is not recommended that you run and migrate SQLite in a
  84. production environment unless you are very aware of the risks and
  85. its limitations; the support Django ships with is designed to allow
  86. developers to use SQLite on their local machines to develop less complex
  87. Django projects without the need for a full database.
  88. Workflow
  89. --------
  90. Working with migrations is simple. Make changes to your models - say, add
  91. a field and remove a model - and then run :djadmin:`makemigrations`::
  92. $ python manage.py makemigrations
  93. Migrations for 'books':
  94. 0003_auto.py:
  95. - Alter field author on book
  96. Your models will be scanned and compared to the versions currently
  97. contained in your migration files, and then a new set of migrations
  98. will be written out. Make sure to read the output to see what
  99. ``makemigrations`` thinks you have changed - it's not perfect, and for
  100. complex changes it might not be detecting what you expect.
  101. Once you have your new migration files, you should apply them to your
  102. database to make sure they work as expected::
  103. $ python manage.py migrate
  104. Operations to perform:
  105. Apply all migrations: books
  106. Running migrations:
  107. Rendering model states... DONE
  108. Applying books.0003_auto... OK
  109. The command runs in two stages; first, it synchronizes unmigrated apps, and
  110. then it runs any migrations that have not yet been applied.
  111. Once the migration is applied, commit the migration and the models change
  112. to your version control system as a single commit - that way, when other
  113. developers (or your production servers) check out the code, they'll
  114. get both the changes to your models and the accompanying migration at the
  115. same time.
  116. Version control
  117. ~~~~~~~~~~~~~~~
  118. Because migrations are stored in version control, you'll occasionally
  119. come across situations where you and another developer have both committed
  120. a migration to the same app at the same time, resulting in two migrations
  121. with the same number.
  122. Don't worry - the numbers are just there for developers' reference, Django
  123. just cares that each migration has a different name. Migrations specify which
  124. other migrations they depend on - including earlier migrations in the same
  125. app - in the file, so it's possible to detect when there's two new migrations
  126. for the same app that aren't ordered.
  127. When this happens, Django will prompt you and give you some options. If it
  128. thinks it's safe enough, it will offer to automatically linearize the two
  129. migrations for you. If not, you'll have to go in and modify the migrations
  130. yourself - don't worry, this isn't difficult, and is explained more in
  131. :ref:`migration-files` below.
  132. Dependencies
  133. ------------
  134. While migrations are per-app, the tables and relationships implied by
  135. your models are too complex to be created for just one app at a time. When
  136. you make a migration that requires something else to run - for example,
  137. you add a ``ForeignKey`` in your ``books`` app to your ``authors`` app - the
  138. resulting migration will contain a dependency on a migration in ``authors``.
  139. This means that when you run the migrations, the ``authors`` migration runs
  140. first and creates the table the ``ForeignKey`` references, and then the migration
  141. that makes the ``ForeignKey`` column runs afterwards and creates the constraint.
  142. If this didn't happen, the migration would try to create the ``ForeignKey``
  143. column without the table it's referencing existing and your database would
  144. throw an error.
  145. This dependency behavior affects most migration operations where you
  146. restrict to a single app. Restricting to a single app (either in
  147. ``makemigrations`` or ``migrate``) is a best-efforts promise, and not
  148. a guarantee; any other apps that need to be used to get dependencies correct
  149. will be.
  150. .. _migration-files:
  151. Migration files
  152. ---------------
  153. Migrations are stored as an on-disk format, referred to here as
  154. "migration files". These files are actually just normal Python files with
  155. an agreed-upon object layout, written in a declarative style.
  156. A basic migration file looks like this::
  157. from django.db import migrations, models
  158. class Migration(migrations.Migration):
  159. dependencies = [("migrations", "0001_initial")]
  160. operations = [
  161. migrations.DeleteModel("Tribble"),
  162. migrations.AddField("Author", "rating", models.IntegerField(default=0)),
  163. ]
  164. What Django looks for when it loads a migration file (as a Python module) is
  165. a subclass of ``django.db.migrations.Migration`` called ``Migration``. It then
  166. inspects this object for four attributes, only two of which are used
  167. most of the time:
  168. * ``dependencies``, a list of migrations this one depends on.
  169. * ``operations``, a list of ``Operation`` classes that define what this
  170. migration does.
  171. The operations are the key; they are a set of declarative instructions which
  172. tell Django what schema changes need to be made. Django scans them and
  173. builds an in-memory representation of all of the schema changes to all apps,
  174. and uses this to generate the SQL which makes the schema changes.
  175. That in-memory structure is also used to work out what the differences are
  176. between your models and the current state of your migrations; Django runs
  177. through all the changes, in order, on an in-memory set of models to come
  178. up with the state of your models last time you ran ``makemigrations``. It
  179. then uses these models to compare against the ones in your ``models.py`` files
  180. to work out what you have changed.
  181. You should rarely, if ever, need to edit migration files by hand, but
  182. it's entirely possible to write them manually if you need to. Some of the
  183. more complex operations are not autodetectable and are only available via
  184. a hand-written migration, so don't be scared about editing them if you have to.
  185. Custom fields
  186. ~~~~~~~~~~~~~
  187. You can't modify the number of positional arguments in an already migrated
  188. custom field without raising a ``TypeError``. The old migration will call the
  189. modified ``__init__`` method with the old signature. So if you need a new
  190. argument, please create a keyword argument and add something like
  191. ``assert kwargs.get('argument_name') is not None`` in the constructor.
  192. .. _using-managers-in-migrations:
  193. Model managers
  194. ~~~~~~~~~~~~~~
  195. .. versionadded:: 1.8
  196. You can optionally serialize managers into migrations and have them available
  197. in :class:`~django.db.migrations.operations.RunPython` operations. This is done
  198. by defining a ``use_in_migrations`` attribute on the manager class::
  199. class MyManager(models.Manager):
  200. use_in_migrations = True
  201. class MyModel(models.Model):
  202. objects = MyManager()
  203. If you are using the :meth:`~django.db.models.from_queryset` function to
  204. dynamically generate a manager class, you need to inherit from the generated
  205. class to make it importable::
  206. class MyManager(MyBaseManager.from_queryset(CustomQuerySet)):
  207. use_in_migrations = True
  208. class MyModel(models.Model):
  209. objects = MyManager()
  210. Please refer to the notes about :ref:`historical-models` in migrations to see
  211. the implications that come along.
  212. Adding migrations to apps
  213. -------------------------
  214. Adding migrations to new apps is straightforward - they come preconfigured to
  215. accept migrations, and so just run :djadmin:`makemigrations` once you've made
  216. some changes.
  217. If your app already has models and database tables, and doesn't have migrations
  218. yet (for example, you created it against a previous Django version), you'll
  219. need to convert it to use migrations; this is a simple process::
  220. $ python manage.py makemigrations your_app_label
  221. This will make a new initial migration for your app. Now, when you run
  222. :djadmin:`migrate`, Django will detect that you have an initial migration
  223. *and* that the tables it wants to create already exist, and will mark the
  224. migration as already applied.
  225. Note that this only works given two things:
  226. * You have not changed your models since you made their tables. For migrations
  227. to work, you must make the initial migration *first* and then make changes,
  228. as Django compares changes against migration files, not the database.
  229. * You have not manually edited your database - Django won't be able to detect
  230. that your database doesn't match your models, you'll just get errors when
  231. migrations try to modify those tables.
  232. .. versionadded:: 1.8
  233. If you want to give the migration(s) a meaningful name instead of a generated one,
  234. you can use the :djadminopt:`--name` option::
  235. $ python manage.py makemigrations --name changed_my_model your_app_label
  236. .. _historical-models:
  237. Historical models
  238. -----------------
  239. When you run migrations, Django is working from historical versions of your
  240. models stored in the migration files. If you write Python code using the
  241. :class:`~django.db.migrations.operations.RunPython` operation, or if you have
  242. ``allow_migrate`` methods on your database routers, you will be exposed to
  243. these versions of your models.
  244. Because it's impossible to serialize arbitrary Python code, these historical
  245. models will not have any custom methods that you have defined. They will,
  246. however, have the same fields, relationships, managers (limited to those with
  247. ``use_in_migrations = True``) and ``Meta`` options (also versioned, so they may
  248. be different from your current ones).
  249. .. warning::
  250. This means that you will NOT have custom ``save()`` methods called on objects
  251. when you access them in migrations, and you will NOT have any custom
  252. constructors or instance methods. Plan appropriately!
  253. References to functions in field options such as ``upload_to`` and
  254. ``limit_choices_to`` and model manager declarations with managers having
  255. ``use_in_migrations = True`` are serialized in migrations, so the functions and
  256. classes will need to be kept around for as long as there is a migration
  257. referencing them. Any :doc:`custom model fields </howto/custom-model-fields>`
  258. will also need to be kept, since these are imported directly by migrations.
  259. In addition, the base classes of the model are just stored as pointers, so you
  260. must always keep base classes around for as long as there is a migration that
  261. contains a reference to them. On the plus side, methods and managers from these
  262. base classes inherit normally, so if you absolutely need access to these you
  263. can opt to move them into a superclass.
  264. .. _migrations-removing-model-fields:
  265. Considerations when removing model fields
  266. -----------------------------------------
  267. .. versionadded:: 1.8
  268. Similar to the "references to historical functions" considerations described in
  269. the previous section, removing custom model fields from your project or
  270. third-party app will cause a problem if they are referenced in old migrations.
  271. To help with this situation, Django provides some model field attributes to
  272. assist with model field deprecation using the :doc:`system checks framework
  273. </topics/checks>`.
  274. Add the ``system_check_deprecated_details`` attribute to your model field
  275. similar to the following::
  276. class IPAddressField(Field):
  277. system_check_deprecated_details = {
  278. 'msg': (
  279. 'IPAddressField has been deprecated. Support for it (except '
  280. 'in historical migrations) will be removed in Django 1.9.'
  281. ),
  282. 'hint': 'Use GenericIPAddressField instead.', # optional
  283. 'id': 'fields.W900', # pick a unique ID for your field.
  284. }
  285. After a deprecation period of your choosing (two major releases for fields in
  286. Django itself), change the ``system_check_deprecated_details`` attribute to
  287. ``system_check_removed_details`` and update the dictionary similar to::
  288. class IPAddressField(Field):
  289. system_check_removed_details = {
  290. 'msg': (
  291. 'IPAddressField has been removed except for support in '
  292. 'historical migrations.'
  293. ),
  294. 'hint': 'Use GenericIPAddressField instead.',
  295. 'id': 'fields.E900', # pick a unique ID for your field.
  296. }
  297. You should keep the field's methods that are required for it to operate in
  298. database migrations such as ``__init__()``, ``deconstruct()``, and
  299. ``get_internal_type()``. Keep this stub field for as long as any migrations
  300. which reference the field exist. For example, after squashing migrations and
  301. removing the old ones, you should be able to remove the field completely.
  302. .. _data-migrations:
  303. Data Migrations
  304. ---------------
  305. As well as changing the database schema, you can also use migrations to change
  306. the data in the database itself, in conjunction with the schema if you want.
  307. Migrations that alter data are usually called "data migrations"; they're best
  308. written as separate migrations, sitting alongside your schema migrations.
  309. Django can't automatically generate data migrations for you, as it does with
  310. schema migrations, but it's not very hard to write them. Migration files in
  311. Django are made up of :doc:`Operations </ref/migration-operations>`, and
  312. the main operation you use for data migrations is
  313. :class:`~django.db.migrations.operations.RunPython`.
  314. To start, make an empty migration file you can work from (Django will put
  315. the file in the right place, suggest a name, and add dependencies for you)::
  316. python manage.py makemigrations --empty yourappname
  317. Then, open up the file; it should look something like this::
  318. # -*- coding: utf-8 -*-
  319. from django.db import models, migrations
  320. class Migration(migrations.Migration):
  321. dependencies = [
  322. ('yourappname', '0001_initial'),
  323. ]
  324. operations = [
  325. ]
  326. Now, all you need to do is create a new function and have
  327. :class:`~django.db.migrations.operations.RunPython` use it.
  328. :class:`~django.db.migrations.operations.RunPython` expects a callable as its argument
  329. which takes two arguments - the first is an :doc:`app registry
  330. </ref/applications/>` that has the historical versions of all your models
  331. loaded into it to match where in your history the migration sits, and the
  332. second is a :doc:`SchemaEditor </ref/schema-editor>`, which you can use to
  333. manually effect database schema changes (but beware, doing this can confuse
  334. the migration autodetector!)
  335. Let's write a simple migration that populates our new ``name`` field with the
  336. combined values of ``first_name`` and ``last_name`` (we've come to our senses
  337. and realized that not everyone has first and last names). All we
  338. need to do is use the historical model and iterate over the rows::
  339. # -*- coding: utf-8 -*-
  340. from django.db import models, migrations
  341. def combine_names(apps, schema_editor):
  342. # We can't import the Person model directly as it may be a newer
  343. # version than this migration expects. We use the historical version.
  344. Person = apps.get_model("yourappname", "Person")
  345. for person in Person.objects.all():
  346. person.name = "%s %s" % (person.first_name, person.last_name)
  347. person.save()
  348. class Migration(migrations.Migration):
  349. dependencies = [
  350. ('yourappname', '0001_initial'),
  351. ]
  352. operations = [
  353. migrations.RunPython(combine_names),
  354. ]
  355. Once that's done, we can just run ``python manage.py migrate`` as normal and
  356. the data migration will run in place alongside other migrations.
  357. You can pass a second callable to
  358. :class:`~django.db.migrations.operations.RunPython` to run whatever logic you
  359. want executed when migrating backwards. If this callable is omitted, migrating
  360. backwards will raise an exception.
  361. .. _data-migrations-and-multiple-databases:
  362. Data migrations and multiple databases
  363. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  364. When using multiple databases, you may need to figure out whether or not to
  365. run a migration against a particular database. For example, you may want to
  366. **only** run a migration on a particular database.
  367. In order to do that you can check the database connection's alias inside a
  368. ``RunPython`` operation by looking at the ``schema_editor.connection.alias``
  369. attribute::
  370. from django.db import migrations
  371. def forwards(apps, schema_editor):
  372. if not schema_editor.connection.alias == 'default':
  373. return
  374. # Your migration code goes here
  375. class Migration(migrations.Migration):
  376. dependencies = [
  377. # Dependencies to other migrations
  378. ]
  379. operations = [
  380. migrations.RunPython(forwards),
  381. ]
  382. .. versionadded:: 1.8
  383. You can also provide hints that will be passed to the :meth:`allow_migrate()`
  384. method of database routers as ``**hints``:
  385. .. snippet::
  386. :filename: myapp/dbrouters.py
  387. class MyRouter(object):
  388. def allow_migrate(self, db, model, **hints):
  389. if 'target_db' in hints:
  390. return db == hints['target_db']
  391. return True
  392. Then, to leverage this in your migrations, do the following::
  393. from django.db import migrations
  394. def forwards(apps, schema_editor):
  395. # Your migration code goes here
  396. class Migration(migrations.Migration):
  397. dependencies = [
  398. # Dependencies to other migrations
  399. ]
  400. operations = [
  401. migrations.RunPython(forwards, hints={'target_db': 'default'}),
  402. ]
  403. More advanced migrations
  404. ~~~~~~~~~~~~~~~~~~~~~~~~
  405. If you're interested in the more advanced migration operations, or want
  406. to be able to write your own, see the :doc:`migration operations reference
  407. </ref/migration-operations>`.
  408. .. _migration-squashing:
  409. Squashing migrations
  410. --------------------
  411. You are encouraged to make migrations freely and not worry about how many you
  412. have; the migration code is optimized to deal with hundreds at a time without
  413. much slowdown. However, eventually you will want to move back from having
  414. several hundred migrations to just a few, and that's where squashing comes in.
  415. Squashing is the act of reducing an existing set of many migrations down to
  416. one (or sometimes a few) migrations which still represent the same changes.
  417. Django does this by taking all of your existing migrations, extracting their
  418. ``Operation``\s and putting them all in sequence, and then running an optimizer
  419. over them to try and reduce the length of the list - for example, it knows
  420. that :class:`~django.db.migrations.operations.CreateModel` and
  421. :class:`~django.db.migrations.operations.DeleteModel` cancel each other out,
  422. and it knows that :class:`~django.db.migrations.operations.AddField` can be
  423. rolled into :class:`~django.db.migrations.operations.CreateModel`.
  424. Once the operation sequence has been reduced as much as possible - the amount
  425. possible depends on how closely intertwined your models are and if you have
  426. any :class:`~django.db.migrations.operations.RunSQL`
  427. or :class:`~django.db.migrations.operations.RunPython` operations (which can't
  428. be optimized through) - Django will then write it back out into a new set of
  429. initial migration files.
  430. These files are marked to say they replace the previously-squashed migrations,
  431. so they can coexist with the old migration files, and Django will intelligently
  432. switch between them depending where you are in the history. If you're still
  433. part-way through the set of migrations that you squashed, it will keep using
  434. them until it hits the end and then switch to the squashed history, while new
  435. installs will just use the new squashed migration and skip all the old ones.
  436. This enables you to squash and not mess up systems currently in production
  437. that aren't fully up-to-date yet. The recommended process is to squash, keeping
  438. the old files, commit and release, wait until all systems are upgraded with
  439. the new release (or if you're a third-party project, just ensure your users
  440. upgrade releases in order without skipping any), and then remove the old files,
  441. commit and do a second release.
  442. The command that backs all this is :djadmin:`squashmigrations` - just pass
  443. it the app label and migration name you want to squash up to, and it'll get to
  444. work::
  445. $ ./manage.py squashmigrations myapp 0004
  446. Will squash the following migrations:
  447. - 0001_initial
  448. - 0002_some_change
  449. - 0003_another_change
  450. - 0004_undo_something
  451. Do you wish to proceed? [yN] y
  452. Optimizing...
  453. Optimized from 12 operations to 7 operations.
  454. Created new squashed migration /home/andrew/Programs/DjangoTest/test/migrations/0001_squashed_0004_undo_somthing.py
  455. You should commit this migration but leave the old ones in place;
  456. the new migration will be used for new installs. Once you are sure
  457. all instances of the codebase have applied the migrations you squashed,
  458. you can delete them.
  459. Note that model interdependencies in Django can get very complex, and squashing
  460. may result in migrations that do not run; either mis-optimized (in which case
  461. you can try again with ``--no-optimize``, though you should also report an issue),
  462. or with a ``CircularDependencyError``, in which case you can manually resolve it.
  463. To manually resolve a ``CircularDependencyError``, break out one of
  464. the ForeignKeys in the circular dependency loop into a separate
  465. migration, and move the dependency on the other app with it. If you're unsure,
  466. see how makemigrations deals with the problem when asked to create brand
  467. new migrations from your models. In a future release of Django, squashmigrations
  468. will be updated to attempt to resolve these errors itself.
  469. Once you've squashed your migration, you should then commit it alongside the
  470. migrations it replaces and distribute this change to all running instances
  471. of your application, making sure that they run ``migrate`` to store the change
  472. in their database.
  473. After this has been done, you must then transition the squashed migration to
  474. a normal initial migration, by:
  475. - Deleting all the migration files it replaces
  476. - Removing the ``replaces`` argument in the ``Migration`` class of the
  477. squashed migration (this is how Django tells that it is a squashed migration)
  478. .. note::
  479. Once you've squashed a migration, you should not then re-squash that squashed
  480. migration until you have fully transitioned it to a normal migration.
  481. .. _migration-serializing:
  482. Serializing values
  483. ------------------
  484. Migrations are just Python files containing the old definitions of your models
  485. - thus, to write them, Django must take the current state of your models and
  486. serialize them out into a file.
  487. While Django can serialize most things, there are some things that we just
  488. can't serialize out into a valid Python representation - there's no Python
  489. standard for how a value can be turned back into code (``repr()`` only works
  490. for basic values, and doesn't specify import paths).
  491. Django can serialize the following:
  492. - ``int``, ``long``, ``float``, ``bool``, ``str``, ``unicode``, ``bytes``, ``None``
  493. - ``list``, ``set``, ``tuple``, ``dict``
  494. - ``datetime.date``, ``datetime.time``, and ``datetime.datetime`` instances
  495. (include those that are timezone-aware)
  496. - ``decimal.Decimal`` instances
  497. - Any Django field
  498. - Any function or method reference (e.g. ``datetime.datetime.today``) (must be in module's top-level scope)
  499. - Any class reference (must be in module's top-level scope)
  500. - Anything with a custom ``deconstruct()`` method (:ref:`see below <custom-deconstruct-method>`)
  501. .. versionchanged:: 1.7.1
  502. Support for serializing timezone-aware datetimes was added.
  503. Django can serialize the following on Python 3 only:
  504. - Unbound methods used from within the class body (see below)
  505. Django cannot serialize:
  506. - Nested classes
  507. - Arbitrary class instances (e.g. ``MyClass(4.3, 5.7)``)
  508. - Lambdas
  509. Due to the fact ``__qualname__`` was only introduced in Python 3, Django can only
  510. serialize the following pattern (an unbound method used within the class body)
  511. on Python 3, and will fail to serialize a reference to it on Python 2::
  512. class MyModel(models.Model):
  513. def upload_to(self):
  514. return "something dynamic"
  515. my_file = models.FileField(upload_to=upload_to)
  516. If you are using Python 2, we recommend you move your methods for upload_to
  517. and similar arguments that accept callables (e.g. ``default``) to live in
  518. the main module body, rather than the class body.
  519. .. _custom-deconstruct-method:
  520. Adding a deconstruct() method
  521. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  522. You can let Django serialize your own custom class instances by giving the class
  523. a ``deconstruct()`` method. It takes no arguments, and should return a tuple
  524. of three things ``(path, args, kwargs)``:
  525. * ``path`` should be the Python path to the class, with the class name included
  526. as the last part (for example, ``myapp.custom_things.MyClass``). If your
  527. class is not available at the top level of a module it is not serializable.
  528. * ``args`` should be a list of positional arguments to pass to your class'
  529. ``__init__`` method. Everything in this list should itself be serializable.
  530. * ``kwargs`` should be a dict of keyword arguments to pass to your class'
  531. ``__init__`` method. Every value should itself be serializable.
  532. .. note::
  533. This return value is different from the ``deconstruct()`` method
  534. :ref:`for custom fields <custom-field-deconstruct-method>` which returns a
  535. tuple of four items.
  536. Django will write out the value as an instantiation of your class with the
  537. given arguments, similar to the way it writes out references to Django fields.
  538. To prevent a new migration from being created each time
  539. :djadmin:`makemigrations` is run, you should also add a ``__eq__()`` method to
  540. the decorated class. This function will be called by Django's migration
  541. framework to detect changes between states.
  542. As long as all of the arguments to your class' constructor are themselves
  543. serializable, you can use the ``@deconstructible`` class decorator from
  544. ``django.utils.deconstruct`` to add the ``deconstruct()`` method::
  545. from django.utils.deconstruct import deconstructible
  546. @deconstructible
  547. class MyCustomClass(object):
  548. def __init__(self, foo=1):
  549. self.foo = foo
  550. ...
  551. def __eq__(self, other):
  552. return self.foo == other.foo
  553. The decorator adds logic to capture and preserve the arguments on their
  554. way into your constructor, and then returns those arguments exactly when
  555. deconstruct() is called.
  556. Supporting Python 2 and 3
  557. -------------------------
  558. In order to generate migrations that support both Python 2 and 3, all string
  559. literals used in your models and fields (e.g. ``verbose_name``,
  560. ``related_name``, etc.), must be consistently either bytestrings or text
  561. (unicode) strings in both Python 2 and 3 (rather than bytes in Python 2 and
  562. text in Python 3, the default situation for unmarked string literals.)
  563. Otherwise running :djadmin:`makemigrations` under Python 3 will generate
  564. spurious new migrations to convert all these string attributes to text.
  565. The easiest way to achieve this is to follow the advice in Django's
  566. :doc:`Python 3 porting guide </topics/python3>` and make sure that all your
  567. modules begin with ``from __future__ import unicode_literals``, so that all
  568. unmarked string literals are always unicode, regardless of Python version. When
  569. you add this to an app with existing migrations generated on Python 2, your
  570. next run of :djadmin:`makemigrations` on Python 3 will likely generate many
  571. changes as it converts all the bytestring attributes to text strings; this is
  572. normal and should only happen once.
  573. .. _upgrading-from-south:
  574. Upgrading from South
  575. --------------------
  576. If you already have pre-existing migrations created with
  577. `South <http://south.aeracode.org>`_, then the upgrade process to use
  578. ``django.db.migrations`` is quite simple:
  579. * Ensure all installs are fully up-to-date with their migrations.
  580. * Remove ``'south'`` from :setting:`INSTALLED_APPS`.
  581. * Delete all your (numbered) migration files, but not the directory or
  582. ``__init__.py`` - make sure you remove the ``.pyc`` files too.
  583. * Run ``python manage.py makemigrations``. Django should see the empty
  584. migration directories and make new initial migrations in the new format.
  585. * Run ``python manage.py migrate``. Django will see that the tables for the
  586. initial migrations already exist and mark them as applied without running
  587. them.
  588. That's it! The only complication is if you have a circular dependency loop
  589. of foreign keys; in this case, ``makemigrations`` might make more than one
  590. initial migration, and you'll need to mark them all as applied using::
  591. python manage.py migrate --fake yourappnamehere
  592. Libraries/Third-party Apps
  593. ~~~~~~~~~~~~~~~~~~~~~~~~~~
  594. If you are a library or app maintainer, and wish to support both South migrations
  595. (for Django 1.6 and below) and Django migrations (for 1.7 and above) you should
  596. keep two parallel migration sets in your app, one in each format.
  597. To aid in this, South 1.0 will automatically look for South-format migrations
  598. in a ``south_migrations`` directory first, before looking in ``migrations``,
  599. meaning that users' projects will transparently use the correct set as long
  600. as you put your South migrations in the ``south_migrations`` directory and
  601. your Django migrations in the ``migrations`` directory.
  602. More information is available in the
  603. `South 1.0 release notes <http://south.readthedocs.org/en/latest/releasenotes/1.0.html#library-migration-path>`_.
  604. .. seealso::
  605. :doc:`The Migrations Operations Reference </ref/migration-operations>`
  606. Covers the schema operations API, special operations, and writing your
  607. own operations.