Line 1:
Line 1:
+
+
{{DISPLAYTITLE:RoadMap}}
This page describe what is the Dolibarr release policy, calendar and rules. It also includes the list of all past and future releases. For a description of the process of building a release, see [[FAQ Release process]].
This page describe what is the Dolibarr release policy, calendar and rules. It also includes the list of all past and future releases. For a description of the process of building a release, see [[FAQ Release process]].
=Roadmap calendar=
=Roadmap calendar=
+
==Number of releases per year==
−
'''Number of releases per year:'''
+
*Major releases: '''2''' (This frequency was set and has not been changed since 2011 - See also chapter "why 2 releases per year" later)
−
−
*Major releases: '''2''' (This frequency was set and has not been changed since 2011 - See end of chapter about why 2 releases per year)
*Minor maintenance releases: '''N''' (depends on bug reports and their criticity)
*Minor maintenance releases: '''N''' (depends on bug reports and their criticity)
+
==Dates of releases==
+
YYYY is current year, YYYY+1 is next year
−
'''Dates are (YYYY is current year, YYYY+1 is next year):'''
<div>
<div>
*January YYYY - Major Release (version A.0.0)
*January YYYY - Major Release (version A.0.0)
Line 34:
Line 36:
−
'''Why 2 releases per year:'''
+
==Why 2 releases per year ? The limitation of FDKs/Mainteners ?==
+
+
The most important points we must think about when we decide the frequency of releases are the productivity (the quantity of features) we try to reach and the stability (the quality).
+
Let's have a look a this points:
+
+
Dolibarr has an integration rate to merge modifications of code (we call this "'''Pull Requests'''" or "'''PR'''") of around 95% (Calculation done from PR processed vs PR suggested by developers on GitHub). Hoping to have more merged PRs (so more features), and therefore to have a rate of 98% for example is clearly utopian especially when we know that the merge rate is between 30% and 85% on other projects of equivalent size (Odoo: 30%, ERPNext 85%, measured in 2022, so after 20 years of existence).
+
+
So what is blocking the integration of more features today is the instability that each feature merge generates, and the stabilization phase that is necessary to “digest” the Pull Requests of evolution. We must know that the time and workload to stabilize integrated developments is exponential with the number of integrated PRs, thus:
+
+
*If we release 2 times less often (so 1 major version every year), the time and efforts to “stabilize” is multiplied by 4 (so releasing is harder).
+
*Seen another way, for an identical result in terms of evolution/feature in the same time, the workload for developers is multiplied by 2 (so less efficient).
+
*Or again, for an identical result in terms of evolution and an identical workload, the quality of stabilization is divided by 2 if we release 2 times less often (so lower quality).
+
+
Today the integration of new PRs is currently deliberately slowed down (this does not prevent Dolibarr from being one of the opensource projects with a highest pace of integrated PR), in order to be able to digest the integrated PRs. Indeed, the bottleneck is mainly in the number of contributors who “correct and stabilize” the integrated PRs. Let's recall the figures, evaluated during a former devcamp: On Dolibarr, for 1 PR of integrated evolution, you need to obtain approximately 2 PR of stabilization fix (2022 evaluation made on Odoo: 2.5, on ERPNext: 7).
+
+
However, today the number of enhancement proposed (and which are integrated) is greater than the number of fixes or stabilization (standardization, security, etc.) proposed while it should be 1 PR out of 3, to be at the balance (3 = 1 for feature + 2 for stabilization).
+
In short, there is no under-staffing on the merge (in fact the workload when you know the app well is quite low) but we frequently have an under-staffing on the '''Fixers''', '''Debuggers''' and '''Killers of Technical Debt''' that I would call with the initials, the "'''FDK'''s" for the following (FDKs are those who work, mainly during a beta phase, to make the application stable and/or coherent, who correct regressions, but also during the development phases who work to reduce technical debt for example). Linus Torvald, from the Linux project, also call them '''The Maintainers''' (vs The developers) and said: "''We do not have enough maintainers''". Dolibarr also miss such contributors on old released versions (when we have too much on develop version).
+
+
The '''Merger(s)''' can be replaced: Its tasks requires strong technical knowledge, history and anticipatory vision of course, but need a little mobilization compared to size of the project (i.e: load in 2024 is 2 half days per week only).
+
+
On the other hand, what the project is at risk on is the lack of FDK/Maintener (because it's an activity which requires a large investment of work, several full time equivalent). This is where the “bus factor” is located on a community project: on the FDKs/Mainteners (I’ll let you see the definition of "Bus Factor" on Wikipedia). The idea of releasing more often is the solution taken by many projects to make stabilization easier (remind: making a version stable is exponential to the amount of evolutions of this version, so releasing often means easier to stabilize), to the point of pushing the system into "rolling" release, monthly, or weekly by some. So why not doing the same in Dolibarr to increase the stability and to reduce the workload ?
+
+
For Dolibarr, a monthly or even quarterly pace is unfortunately too fast because it is necessary to give the community time to analyze, comment, test and fix on PR (volunteers are working at their own pace, so it needs a more important delay for discussion, coordination, validation). This is due to the '''community only''' mode of the project (when introducing such delays is not necessary in a constrained scheduled project with full employees in same company).
+
+
In short, if you have ideas for increasing the number of “FDKs/Mainteners”, or encouraging actors to convert from feature developers to FDKs, it is welcome, because this is the bottleneck and where the project is at risk (the problem is that feature developers sell their production to customers so we have a large amount of such contributions, but not the FDKs when you have a mature solution like Dolibarr). If we find a “trick” to motivate actors to take on this role in support of the handful of existing FDKs, Dolibarr project will be taken on another dimension…
−
The most important point we must think about when we decide the frequency of a release are the productivity of features we try to reach and the stability.
+
==What about Long Term Support (LTS) version ?==
−
Let's have a look a this point:
−
Dolibarr has an integration rate to integrate modifications of code (we call this "'''Pull Requests'''" or "'''PR'''") of around 95% (Calculation done from PR processed vs PR suggested by developers on GitHub). Hoping to have more merged PRs (so more features), and therefore to have a rate of 98% for example is clearly utopian especially when we know that the merge rate is rather 50% on other projects of equivalent size (example Odoo: 30%, but 85 % for ERPNext, measured in 2022).
+
It is common to integrate bug fixes in version develop, stable N, stable N-1, stable N-2 until N-4 (because it makes life easier for the developer to not go back too far), but any bug fix submitted, even in a very old version of Dolibarr (N-x), is integrated (if the PR respects the best practice of the "minimal change for bug fix" of course). So, some people uses to say that every Dolibarr version are LTS. But it is better to say that all versions of Dolibarr are "open to a LTS process". In reality, few developers submit fixes for versions beyond N-5, so very old versions are maintained but only when maintenance contributions are submitted, and because few contributions are submitted for very old versions, we must admit that there is only a "limited" community maintenance support for very old versions.
−
So what is blocking the integration of more features today is the instability that each feature merge generates, and the stabilization phase which is necessary to “digest” a Pull Request for evolution. This time and workload to stabilize integrated developments is exponential with the number of integrated PRs, thus:
+
This is for example a screenshot done when last stable version was v19. It shows the latest recent maintenance fixes done in past versions. Going back 8 major versions in the past (so 4 years ago), we see we still have commits merged in the past month for all of them. So we are, "naturally", close to LTS at 4 years but far from 6 years LTS (no commits done in the last 2 years for the major versions N-12 and olders when this analysis was done).
−
* If we release 2 times less often (so 1 every year), the time and efforts to “stabilize” is multiplied by 4.
−
* Seen another way, for an identical result in terms of evolution, the workload is multiplied by 2.
−
* Or again, to an identical result in terms of evolution and an identical workload, the quality of stabilization is divided by 2 by releasing 2 times less often.
−
Today the integration of new PRs is currently deliberately slowed down in order to be able to digest the integrated PRs. Indeed, the bottleneck is mainly in the number of contributors who “correct and stabilize” the integrated PRs. Let's recall the figures, evaluated during a former devcamp: On Dolibarr, for 1 PR of integrated evolution, you need to obtain approximately 2 PR of stabilization fix (2022 evaluation made on Odoo: 2.5, on erpnext: 7).
−
However, today the number of developments proposed and which are integrated is greater than the number of fixes or stabilizations (standardization, security, etc.) proposed while it should be 1 PR out of 3 only to be at the balance (3 = 1 for feature + 2 for stabilization).
+
<div class="divforimgcentpercentx">
−
In short, there is no understaffing on the merge (in fact the workload when you know the app well is quite low) but we will always have an understaffing on the Fixers, Debuggers and Technical Debt Killers that I would call with the initials, the '''FDK'''s for the following (FDKs are those who work, mainly during a beta phase, to make the application stable and/or coherent, correct regressions, but also during the dev phases to reduce technical debt for example).
+
[[File:Screenshot travis - CI result.png|450px]]
+
</div>
−
A merger can replace himself because it is a task that requires strong technical knowledge, history and anticipatory vision of course, but little mobilization.
−
On the other hand, where the project is at risk is the lack of FDK (because it relies on a smaller team and it is an activity which requires a large investment of work). This is where the “bus factor” is located on a community project: on the FDK (I’ll let you see the definition of Bus Factor on Wikipedia). The idea of releasing more often (reminder: making a version stable is exponential to the amount of evolution of this version) is the solution taken by many projects to make stabilization easier, to the point of pushing the system into "rolling" release, monthly, or weekly by some.
+
In most common cases, this is not a problem because Dolibarr guarantees that you can upgrade to a recent version at any time from any old version (even on a version N-20 released 10 years ago), in few seconds and without loosing data, so you can always benefit of the latest fixes. But if you made some custom modifications in the core or use external modules not yet compatible with recent versions, upgrade may overwrite your custom changes or may make old external modules not working anymore. For such cases, you can get contractual support for LTS from some open source companies (Some integrators and some Saas hosting services provide such a support (https://partners.dolibarr.org).
−
For Dolibarr, a monthly or even quarterly pace is unfortunately too fast because it is necessary to give the community time to analyze and comment on each PR due to the community mode of the project (which is not done in an unconstrained scheduled proprietary projet).
−
In short, if you have ideas for increasing the number of “FDKs”, or encouraging actors to convert from business developers to FDKs, it is welcome, because this is the bottleneck and where the project is at risk (the problem is that business developer sells their production to customers so we have a large amount of such contributions, but not the FDKs). If we find a “trick” to motivate actors to take on this role in support of the handful of existing FDKs, Dolibarr project will be taken on another dimension…
=Branch and Source control management=
=Branch and Source control management=
−
All new features have to be pushed into '''develop''' branch.
+
All new features have to be pushed into '''develop''' branch. Bug fixes are into '''version branches''' (trying to follow this [[Decision algorithm for branch choice of a PR]]).
+
Following the release calendar, branches with name of major version '''x.y''' are created by the release manager. According to when we are in the release cycle, those branches can be '''frozen''' branches or '''maintenance''' branches. See here what this means:
Following the release calendar, branches with name of major version '''x.y''' are created by the release manager. According to when we are in the release cycle, those branches can be '''frozen''' branches or '''maintenance''' branches. See here what this means:
−
==Freeze definition==
+
==Freeze definition and date==
When we make a freeze of code, it means we start the beta period. It does not means that we must not change the code for the targeted version. It means that we can do some thing, and we can't for some other. This is a generic definition of a Freeze.
When we make a freeze of code, it means we start the beta period. It does not means that we must not change the code for the targeted version. It means that we can do some thing, and we can't for some other. This is a generic definition of a Freeze.
Line 113:
Line 133:
−
== Release Process ==
+
==Merging PR process (develop or maintenance ?)==
+
When a change of code is submited for merging, the Branch Merger can use this decision chart to know if a PR can be merged into the '''maintenance branch''' or must be switched into the '''develop branch''':
+
+
[[File:Chart of decision.png]]
+
+
==Release Process==
For information about the release process, see [[FAQ_Release_process]].
For information about the release process, see [[FAQ_Release_process]].
=List of past versions=
=List of past versions=
−
This Roadmap page is an index of all dedicated pages to RoadMap of each version (past and future). List of each change is available into the [https://github.com/Dolibarr/dolibarr/blob/develop/ChangeLog ChangeLog file]
+
This Roadmap page is an index of all dedicated pages to RoadMap of each version (past and future). List of each change is available into the cumulated [https://github.com/Dolibarr/dolibarr/blob/develop/ChangeLog ChangeLog file]