I'm going to start building openmpi 5.0.0 and its requirements (pmix 4.2.7, prrte 3.0.2) and dependencies in a side-tag starting tomorrow. Notable changes are:
* Dropping support for 32-bit * Dropping support for C++ API * Change in the environment variable to allow oversubscription (running with more processes than available cores)
I will be making changes to dependent packages to address these changes.
I've been rebuilding deps in COPR (https://copr.fedorainfracloud.org/coprs/orion/pmix-4.2/builds/) and most rebuild fine. One exception is MUSIC which depends on the C++ API. There is a longstanding upstream issue to address this. Hopefully this will finally get dealt with.
There are no soname bumps, but pmix has proved problematic in the past but its deps will be rebuilt.
On 10/28/23 13:36, Orion Poplawski wrote:
I'm going to start building openmpi 5.0.0 and its requirements (pmix 4.2.7, prrte 3.0.2) and dependencies in a side-tag starting tomorrow. Notable changes are:
- Dropping support for 32-bit
- Dropping support for C++ API
- Change in the environment variable to allow oversubscription (running
with more processes than available cores)
I will be making changes to dependent packages to address these changes.
I've been rebuilding deps in COPR (https://copr.fedorainfracloud.org/coprs/orion/pmix-4.2/builds/) and most rebuild fine. One exception is MUSIC which depends on the C++ API. There is a longstanding upstream issue to address this. Hopefully this will finally get dealt with.
There are no soname bumps, but pmix has proved problematic in the past but its deps will be rebuilt.
The side tag has been merged. I rebuilt all packages that depended on libmpi_cxx.so - except MUSIC which needs upstream to drop it's requirement on the C++ API.
Other OpenMPI deps may now be FTBFS/FTI due to the lack of openmpi on i686 but packagers can deal with that on their own schedule. koschei will not detect this but perhaps the FTI check will.
Finally, the new method for allowing over-subscription is:
PRTE_MCA_rmaps_default_mapping_policy=:oversubscribe
Orion
Hi Orion,
Is there any particular testing you would like to see done with this? Are there projects that are using 5.0 at this point? Thanks so much for your time.
Cheers,
-Morgan
On Mon, Oct 30, 2023 at 6:49 AM Orion Poplawski orion@nwra.com wrote:
On 10/28/23 13:36, Orion Poplawski wrote:
I'm going to start building openmpi 5.0.0 and its requirements (pmix 4.2.7, prrte 3.0.2) and dependencies in a side-tag starting tomorrow. Notable changes are:
- Dropping support for 32-bit
- Dropping support for C++ API
- Change in the environment variable to allow oversubscription (running
with more processes than available cores)
I will be making changes to dependent packages to address these changes.
I've been rebuilding deps in COPR (https://copr.fedorainfracloud.org/coprs/orion/pmix-4.2/builds/) and most rebuild fine. One exception is MUSIC which depends on the C++ API. There is a longstanding upstream issue to address this. Hopefully this will finally get dealt with.
There are no soname bumps, but pmix has proved problematic in the past but its deps will be rebuilt.
The side tag has been merged. I rebuilt all packages that depended on libmpi_cxx.so - except MUSIC which needs upstream to drop it's requirement on the C++ API.
Other OpenMPI deps may now be FTBFS/FTI due to the lack of openmpi on i686 but packagers can deal with that on their own schedule. koschei will not detect this but perhaps the FTI check will.
Finally, the new method for allowing over-subscription is:
PRTE_MCA_rmaps_default_mapping_policy=:oversubscribe
Orion
-- Orion Poplawski he/him/his - surely the least important thing about me IT Systems Manager 720-772-5637 NWRA, Boulder/CoRA Office FAX: 303-415-9702 3380 Mitchell Lane orion@nwra.com Boulder, CO 80301 https://www.nwra.com/
scitech mailing list -- scitech@lists.fedoraproject.org To unsubscribe send an email to scitech-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/scitech@lists.fedoraproject.or... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Nothing beyond the normal. openmpi 5.0 was just released so we're probably a bit out in front (although there have been RCs for almost a year).
On 10/30/23 08:01, Morgan Hough wrote:
Hi Orion,
Is there any particular testing you would like to see done with this? Are there projects that are using 5.0 at this point? Thanks so much for your time.
Cheers,
-Morgan
On Mon, Oct 30, 2023 at 6:49 AM Orion Poplawski orion@nwra.com wrote:
On 10/28/23 13:36, Orion Poplawski wrote:
I'm going to start building openmpi 5.0.0 and its requirements (pmix 4.2.7, prrte 3.0.2) and dependencies in a side-tag starting tomorrow. Notable changes are:
- Dropping support for 32-bit
- Dropping support for C++ API
- Change in the environment variable to allow oversubscription (running
with more processes than available cores)
I will be making changes to dependent packages to address these changes.
I've been rebuilding deps in COPR (https://copr.fedorainfracloud.org/coprs/orion/pmix-4.2/builds/) and most rebuild fine. One exception is MUSIC which depends on the C++ API. There is a longstanding upstream issue to address this. Hopefully this will finally get dealt with.
There are no soname bumps, but pmix has proved problematic in the past but its deps will be rebuilt.
The side tag has been merged. I rebuilt all packages that depended on libmpi_cxx.so - except MUSIC which needs upstream to drop it's requirement on the C++ API.
Other OpenMPI deps may now be FTBFS/FTI due to the lack of openmpi on i686 but packagers can deal with that on their own schedule. koschei will not detect this but perhaps the FTI check will.
Finally, the new method for allowing over-subscription is:
PRTE_MCA_rmaps_default_mapping_policy=:oversubscribe
Orion
-- Orion Poplawski he/him/his - surely the least important thing about me IT Systems Manager 720-772-5637 NWRA, Boulder/CoRA Office FAX: 303-415-9702 3380 Mitchell Lane orion@nwra.com Boulder, CO 80301 https://www.nwra.com/
scitech mailing list -- scitech@lists.fedoraproject.org To unsubscribe send an email to scitech-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/scitech@lists.fedoraproject.or... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
scitech mailing list -- scitech@lists.fedoraproject.org To unsubscribe send an email to scitech-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/scitech@lists.fedoraproject.or... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
scitech@lists.fedoraproject.org