From Fedora Project Wiki
 
Line 70: Line 70:


== Test Results ==
== Test Results ==
=== Basic Tests ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_basic_sanity Sanity]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_makecache_and_clean DNF5 makecache]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_distro-sync DNF5 dsync]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_swap DNF5 Swap]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_repoquery DNF5 repoquery]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_basic_update_packages DNF5 updates]
! References
|-
| [[User:Daniels|Daniels]]
| QEMU Standard PC _Q35 + ICH9, 2009_ MEle Intel® Celeron® N5105 × 4 F38 WS Linux 6.2.2-301.fc38.x86_64 Gnome 44.beta KVM
| {{result|pass}}<ref>Cool Stuff: All pass for "Sanity" test.</ref>
|
|
|
|
|
| <references/>
|-
| [[User:Gyro|Gyro]]
| Fedora 38 test image inside virt-manager
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:Gyro|Gyro]]
| Fedora 38 test image inside virt-manager on Fedora 37
|
|
|
|
| {{result|pass}}
|
| <references/>
|-
| [[User:Renault|Renault]]
| x86_64 on Intel i5-3470 processor + nVidia 1050; fr_FR
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:VladimirSokolenko|VladimirSokolenko]]
| QEMU emulator version 6.2.0 (qemu-6.2.0-17.fc36), Fedora-Workstation-Live-x86_64-38-20230306.n.0.iso VM image
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}}<ref>After successful package downgrade & next update process:
sudo dnf5 update gedit
Unknown argument "update" for command "dnf5"
However, sudo dnf5 upgrade gedit works totally fine
</ref>
| <references/>
|-
| [[User:alciregi|alciregi]]
| Fedora Server aarch64 on Raspberry Pi 4
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:andilinux|andilinux]]
| F38 Beta, Gnome Boxes, en_US, x86_64, Fresh Kernel 6.2.6-300.fc38.x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:bittin|bittin]]
| F38 Beta - Virtualbox
| {{result|warn}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}{{result|pass}}{{result|warn}}<ref>[fedora38beta@fedora ~]$ dnf5 repoquery --info vim
Updating and loading repositories:
Repositories loaded.
guess this is not expected</ref>
| {{result|pass}}
| <references/>
|-
| [[User:bittin|bittin]]
| F38 Last Pre Beta - Virtualbox
| {{result|fail}}<ref>having problems with dnf5 reinstall and download --resolve</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
| {{result|pass}}
| <references/>
|-
| [[User:condor|condor]]
| HP Elite 8300 w/ i5-3470
| {{result|pass}}
|
|
|
|
|
| <references/>
|-
| [[User:danniel|danniel]]
| F38, Libvirt VM
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:emanuelec|emanuelec]]
|  VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>Used VM upgraded from v37</ref>
| <references/>
|-
| [[User:emanuelec|emanuelec]]
| VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:emrakova|emrakova]]
| OpenStack virtual machine, x86_64
| {{result|warn}}<ref>{{bz|2178126}} bash-completion doesn't work at all for dnf5-5.0.6-2.fc38, it works OK for dnf5-5.0.7-20230314005057.17.g160033cc.fc38
bug reported for dnf5 download</ref>
| {{result|pass}}
| {{result|warn}}<ref>alias dsync does not work for dnf5</ref>
| {{result|warn}}<ref>{{bz|2178129}} bug reported for dnf5 swap</ref>
| {{result|warn}}<ref>dnf5 repoquery provides duplicates when the same versions of packages are available in multiple repos, see also https://bugzilla.redhat.com/show_bug.cgi?id=2178126</ref>
| {{result|pass}}<ref>just missing update alias</ref>
| <references/>
|-
| [[User:ewilcox|ewilcox]]
|
| {{result|pass}}<ref>All tests resulted n the expected outcome as per the test page.</ref>
| {{result|pass}}<ref>All tests returned the expected outcome.</ref>
| {{result|pass}}<ref>All tests succeeded.</ref>
|
|
|
| <references/>
|-
| [[User:geraldosimiao|geraldosimiao]]
| F38 KDE beta 1.3 - x86_64 KVM virt-manager UEFI (running on F37 KDE at Acer Aspire V3-571 / i7-3632QM)
| {{result|pass}}<ref>dnf5-5.0.6-2.fc38.x86_64</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>Swaped correctly sddm-wayland to sddm-x11 including upgrade of sddm in same transaction.</ref>
| {{result|pass}}
| {{result|warn}}<ref>At version dnf5-5.0.6-2 there is no "update" alias, only "upgrade". Using dnf5 upgrade all runs fine, without errors.</ref>
| <references/>
|-
| [[User:gianmichele|gianmichele]]
| Fedora 38 KDE with updates testing enabled
|
|
|
|
|
| {{result|warn}}<ref>The downloaded rpm's in /var/cache/libdnf5/<repo>/packages are not removed after operation and might fill up the partition without users consent.
Output in console is very verbose compared to dnf4. "dnf5 upgrade" usually needs more than the the lines of a 1920 x 1200 tty screen.</ref>
| <references/>
|-
| [[User:hricky|hricky]]
| Bare Metal, ASRock H97 Pro4-P2.10, Intel® Core™ i7-4790 × 8, 32.0 GiB RAM, Intel® HD Graphics 4600 (HSW GT2), Fedora Linux 38 (Workstation Edition Prerelease), Kernel: Linux 6.2.5-300.fc38.x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:jdg216|jdg216]]
|
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:lbrabec|lbrabec]]
| F38 QEMU VM aarch64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
|
|
| <references/>
|-
| [[User:lruzicka|lruzicka]]
| F38, fully updated, Libvirt VM
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:markr217|markr217]]
| kvm, 16G, 4 proc
| {{result|pass}}
|
|
|
|
|
| <references/>
|-
| [[User:markr217|markr217]]
| kvm, 16G, 4 proc, F38
|
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:mbanas|mbanas]]
| virtual F38, aarch64.
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>Just the issue with update vs. upgrade.</ref>
| <references/>
|-
| [[User:mikelo2|mikelo2]]
| podman + Raspberry Pi 3 Model B+
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:msmafra|msmafra]]
| https://discussion.fedoraproject.org/u/msmafra/summary
|
|
| {{result|warn}}<ref>I've been running dnf5 since F38 branched, today of all days, sudo dnf5 upgrade or distro-sync did not work.
"Transaction failed: Rpm transaction failed"
After looping with sudo dnf5 distro-sync to each individual package evince was the culprit, all other package installed without warning</ref>
|
|
|
| <references/>
|-
| [[User:mzink|mzink]]
| F38 VM
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:rai510|rai510]]
| Gnome Boxes Fedora-Workstation-Live-x86_64-38-20230313.n.0.iso 
| {{result|pass}}<ref>All PASS</ref>
|
|
|
|
|
| <references/>
|-
| [[User:royboy626|royboy626]]
| Fedora 38 Beta Workstation;Bare Metal; x86_64;ZBOXHD-ND22
| {{result|pass}}<ref>Perhaps man page should state 'download' is to pwd?</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:sgob|sgob]]
| Fedora 38 in a VM, virt-manager.
| {{result|warn}}<ref>Everything went fine and smooth, installing and upgrading thousands of packages. However, for instance, when installing lots of packages, lowest completion bar always reports 100%. I installed texlive-scheme-full to test it.</ref>
| {{result|pass}}
|
|
|
|
| <references/>
|-
| [[User:urtabajev|urtabajev]]
| Gigabyte B75N | i3-3220T | 8GB
| {{result|pass}}
|
|
|
|
|
| <references/>
|-
|}
=== Parity Tests ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_info DNF5 info]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_list DNF5 list]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_history DNF5 history]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_enable_disable_repo DNF5 enable/disable repo]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_search DNF5 search]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_check-update DNF5 check-update]
! [http://fedoraproject.org/wiki/QA:Testcase_DNF_various_options DNF5 assorted options]
! References
|-
| [[User:Renault|Renault]]
| x86_64 on Intel i5-3470 processor + nVidia 1050; fr_FR
| {{result|pass}}<ref>dnf5 info does not exist, used dnf repoquery --info instead</ref>
| {{result|fail}}<ref>dnf5 list does not exist</ref>
| {{result|pass}}<ref>List only transactions done with dnf5, not with dnf (and vice versa)</ref>
| {{result|fail}}<ref>dnf5 config-manager command does not exist, but being able to enable / disable repo for a specific transaction with --enablerepo argument...</ref>
| {{result|fail}}<ref>No available command dnf5 search</ref>
| {{result|fail}}<ref>No available command for dnf5 check-update</ref>
| {{result|pass}}
| <references/>
|-
| [[User:bittin|bittin]]
| F38 Beta - Virtualbox
| {{result|pass}}{{result|pass}}<ref>Works with the version in copr</ref>
| {{result|pass}}{{result|pass}}<ref>Works with the version in copr</ref>
| {{result|fail}}<ref>no undo or rollback</ref>{{result|fail}}<ref>Rollback is having problems</ref>
| {{result|pass}}
| {{result|pass}}{{result|pass}}
| {{result|warn}}<ref>Not implemented yet</ref>{{result|fail}}<ref>Unknown argument "check-update" for command "dnf5"
</ref>
|
| <references/>
|-
| [[User:bittin|bittin]]
| F38 Pre Beta & Beta - Virtualbox
|
|
|
| {{result|fail}}<ref>[fedora38beta@fedora ~]$ sudo dnf5 config-manager --disable updates-testing
Unknown argument "config-manager" for command "dnf5"
</ref>
|
|
|
| <references/>
|-
| [[User:emanuelec|emanuelec]]
| VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
|
|
|
|
|
|
| {{result|pass}}
| <references/>
|-
| [[User:emanuelec|emanuelec]]
| VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
| {{result|warn}}<ref>dnf info dnf works (as per test), but dnf5 info dnf doesnt exist</ref>
| {{result|warn}}<ref> dnf list works (as per test), but dnf5 list doesnt exist </ref>
| {{result|pass}}<ref>List only transactions done with dnf5, not with dnf (and vice versa) </ref>
| {{result|warn}}<ref>dnf5 config-manager command does not exist</ref>
| {{result|warn}}<ref>No available command dnf5 search </ref>
| {{result|warn}}<ref>No available command for dnf5 check-update </ref>
|
| <references/>
|-
| [[User:ewilcox|ewilcox]]
|
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>--info and --last are not recognized arguments. dnf returned the usage: dnf history output.</ref>
| {{result|warn}}<ref>both 'sudo dnf config-manager --disable fedora-modular' and 'sudo dnf config-manager --enable fedora-modular' execute reporting no error. They display no confirmation message that the repository has been enabled or disabled. The only indication of success is that following execution the terminal returns to the command prompt.</ref>
| {{result|warn}}<ref>Expected Results for dnf search nemo:
The following must be true to consider this a successful test run:
The command executes without error. true
The output includes a list of packages that match the search criteria, sorted alphabetically. true
Each package listed should include the package name, a brief description, the version number, and the repository from which it is available. false (ncludes pacage name : descirption)
The output is readable and formatted correctly. true</ref>
| {{result|warn}}<ref>Expected Results
The command executes without error: true
The output includes a list of available package updates, if any, sorted by package name: none available
Each package listed should include the package name, the current version, the available version, the repository from which it is available, and a brief description of the update: none listed
If there are no available package updates, the output should indicate that no updates are available: false - no indication that no updates are available.
The output is readable and formatted correctly: true</ref>
| {{result|fail}}<ref>All dnf commands complete without error: false - sudo dnf install -y --enablerepo=epel --best nginx
Error: Unknown repo: 'epel'
The nginx, git, python3, and vim packages are installed successfully: true
The nodocs option is enabled for the nginx installation: true
The epel repository is disabled during the git installation and enabled during the nginx installation: false sudo dnf install -y --enablerepo=epel --best nginx
Error: Unknown repo: 'epel'
The latest version of nginx is installed during the nginx installation: false sudo dnf install -y --enablerepo=epel --best nginx
Error: Unknown repo: 'epel'
The $releasever value is overridden during the python3 installation: false Package python3-3.11.2-1.fc38.x86_64 is already installed.
The keepcache option is set to 1 during the vim installation: false Package vim-enhanced-2:9.0.1367-1.fc38.x86_64 is already installed.</ref>
| <references/>
|-
| [[User:geraldosimiao|geraldosimiao]]
| F38 KDE beta 1.3 - x86_64 KVM virt-manager UEFI (running on F37 KDE at Acer Aspire V3-571 / i7-3632QM)
| {{result|warn}}<ref>dnf5 have only "dnf5 repoquery --info <package>" and dnf have both methods (info and repoquery).</ref>
| {{result|pass}}<ref>dnf5 list command works fine with unstable version 5.0.7-20230315005850.23.g520edcb2 from copr</ref>{{result|fail}}<ref>No dnf5 list with version 5.0.7-1 from rawhide.</ref>{{result|fail}}<ref>no dnf5 list</ref>
| {{result|warn}}<ref>Both work almost the same way but when we run dnf history info, dnf by default return the last transaction, no need to use the transaction number. DNF5 don't do this, it return nothing, one must use the transaction number always.</ref>
| {{result|fail}}<ref>yeah, no config-manager plugin for dnf5 yet.</ref>
| {{result|pass}}<ref>With version 5.0.7-1 from rawhide "search" command worked just fine</ref>{{result|warn}}<ref>dnf5 don't have search yet, using dnf5 repoquery <package> solve this</ref>
|
|
| <references/>
|-
| [[User:jdg216|jdg216]]
|
| {{result|pass}}
| {{result|warn}}<ref>dnf test ok, but dnf5 doesn't exist</ref>
| {{result|warn}}<ref>dnf history works, but dnf5 needs: dnf history list</ref>
|
|
|
|
| <references/>
|-
| [[User:lruzicka|lruzicka]]
| F38, fully updated, Libvirt VM
| {{result|pass}}<ref>I am using the unstable version from the COPR</ref>
| {{result|pass}}<ref>unstable COPR version</ref>
| {{result|pass}}<ref>`dnf history` shows help and requires additional arguments to be used</ref>
| {{result|fail}}<ref>The `config-manager` subcommand does not exist for me.</ref>
| {{result|pass}}<ref>Using the unstable COPR version.</ref>
| {{result|fail}}<ref>Subcommand does not exist.</ref>
| {{result|pass}}
| <references/>
|-
| [[User:markr217|markr217]]
| kvm, 16G, 4 proc, F38
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail}}<ref>4. dnf config-manager --disable <repository-name> (and --enable ) works fine.
dnf enable/disable failed with:
No such command: enable/disable. Please use /usr/bin/dnf --help
It could be a DNF plugin command, try: "dnf install 'dnf-command(enable/disable)'"
*Note: setup for this test specifies bare metal, I was using a kvm.</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:mikelo2|mikelo2]]
| podman + Raspberry Pi 3 Model B+
| {{result|pass}}
| {{result|pass}}
|
|
|
|
|
| <references/>
|-
| [[User:mzink|mzink]]
| F38 VM
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}}<ref>dnf5 doesn't have the ability to enable/disable repo yet.
dnf & dnf5 repolist is in sync when you enable/disable repo and compare the list.</ref>
| {{result|pass}}
| {{result|fail}}<ref>sudo dnf5 check-update
Unknown argument "check-update" for command "dnf5"
I assume this is expected. Dnf5 is still under development and does not have all dnf subcommands/parameters.</ref>
| {{result|pass}}
| <references/>
|-
| [[User:royboy626|royboy626]]
| Fedora 38 Beta Workstation;Bare Metal; x86_64;ZBOXHD-ND22
| {{result|warn}}<ref>Assume command should be: 'dnf5 repoquery --info <package-name>'
Assuming that: [PASS]</ref>
| {{result|pass}}<ref>'dnf list' [PASS]; 'dnf5 list does not exist</ref>
| {{result|warn}}<ref>'dnf history' [PASS]; dnf5 history not available</ref>
| {{result|warn}}<ref>dnf config-manager <repository-name. [PASS]; dnf5 config-manager unavailable</ref>
| {{result|warn}}<ref>'dnf search <package-name. [PASS]; 'dnf5 search' unavailable</ref>
| {{result|warn}}<ref>'dnf check-update' [PASS]; dnf5 check-update unavailable</ref>
| {{result|warn}}<ref>tests names (Ex. dnf5 history) in 'Parity Tests' section should match the commands within the tests (dnf history)</ref>
| <references/>
|-
|}
=== Exploratory Testing ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_Exploratory_Testing Exploratory Testing]
! References
|-
| [[User:bittin|bittin]]
| F38 Beta - Virtualbox
| {{result|pass}}
| <references/>
|-
| [[User:bittin|bittin]]
| F38 Pre Beta & Beta - Virtualbox
| {{result|pass}}<ref>Upgraded the system with sudo dnf5 distro-sync
worked good even with 300+ packages :)</ref>
| <references/>
|-
| [[User:msmafra|msmafra]]
| Fedora 38 updated 2023-02-14
| {{result|fail}}<ref>dnf5 did not remove unused dependencies:
❯ doas dnf5 remove evince
Removes evince and says Removing unused dependencies: evince-previewer, evince-thumbnailer
❯ doas dnf5 install evince evince-thumbnailer evince-previewer
Package "evince-thumbnailer-44~rc-1.fc38.x86_64" is already installed.
Package "evince-previewer-44~rc-1.fc38.x86_64" is already installed.</ref>
| <references/>
|-
| [[User:msmafra|msmafra]]
| https://discussion.fedoraproject.org/u/msmafra/summary
| {{result|warn}}<ref>dnf5 doesn't have some commands like search,  and makecache and subcommands installed and userinstalled for the history command, for example.  It only has:
install, upgrade, remove, distro-sync, downgrade, reinstall, swap, mark, repoquery, group, environment, module, history, repo, advisory, groupinfo, grouplist, repoinfo, repolist, updateinfo, upgrade-minimal, clean, download, makecache, builddep, changelog</ref>
| <references/>
|-
| [[User:mzink|mzink]]
| F38 VM
| {{result|warn}}<ref>dnf5 does not have all dnf subcommands.
For example:
dnf update - works
dnf5 update - unknown command</ref>
| <references/>
|-
| [[User:urtabajev|urtabajev]]
| Gigabyte B75N | i3-3220T | 8GB
| {{result|fail}}<ref>sudo dnf5 upgrade --enablerepo=updates-testing reports - "Nothing to do."
sudo dnf update --enablerepo=updates-testing --refresh - "Upgrade  24 Packages"</ref>
| <references/>
|-
|}




[[Category:Fedora 38 Test Days]]
[[Category:Fedora 38 Test Days]]

Latest revision as of 11:41, 17 April 2023

DNF 5
Test-days-banner.svg
Date 2023-03-14 to 2023-03-15
Time all day
Website QA/Test Days
Matrix #test-day:fedoraproject.org
Mailing list test


Note.png
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today's installment of Fedora Test Day will focus on testing

  1. dnf5 basic sanity (install, remove, reinstall, download)
  2. dnf5 downgrade / upgrade / update commands
  3. dnf5 makecache / clean commands
  4. dnf5 distro-sync / dsync
  5. any performance issues

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion. Use #dnf or #fedora-test-day channels on libera chat. Alternatively, write on sst-cs-software-management@redhat.com In case of problem related to test day organization/wiki/whatever, please reach out to sumantrom.

  • Development -

Marek Blaha (mblaha), David Cantrell (dcantrell), Evan Goode (egoode), Jan Kolárik (jkolarik), Pavla Kratochvílová (pkratoch), Aleš Matěj (amatej), Jaroslav Mráček (jmracek), Jaroslav Rohel (jrohel), Nicola Sella (nsella)

Prerequisite for Test Day[edit]

  • A system (real or virtual) you can install Fedora to, and not mind if it breaks
  • A Fedora 38 image: download latest 38

How to test?[edit]

Install Fedora 38[edit]

Testing DNF from a live environment is difficult and will likely wind up with the system exhausting available RAM and failing in strange ways, so we recommend you install Fedora 38 for this Test Day.

Update your machine[edit]

Make sure you have all the current updates installed, using the update manager. Note that a clean installed Fedora 38 system will have DNF 4.14, while after update from updates-testing (which is enabled by default), you should have DNF 5 from just execute sudo dnf install dnf5 dnf5-plugins. We are interested in tests with both versions. If you find an issue with one version, it would be very useful to check if it also happens with the other. For the reference, there is a copr repository for dnf5 which is built against upstream.

Run the tests[edit]

Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.

Reporting bugs[edit]

If you have problems with any of the tests, report a bug to Bugzilla usually for the component dnf5. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

Known issues[edit]

  • Dnf5 repoquery lists some packages twice

https://bugzilla.redhat.com/show_bug.cgi?id=2174337

  • Dnf5 group list may stop listing the groups if run for a second time. To workaround, run dnf5 clean all before running dnf5 group list again.

https://bugzilla.redhat.com/show_bug.cgi?id=2173929

  • It may happen that group remove doesn’t remove all packages which has been installed by group install.

https://bugzilla.redhat.com/show_bug.cgi?id=2173927


Test Results[edit]

Basic Tests[edit]

User Profile Sanity DNF5 makecache DNF5 dsync DNF5 Swap DNF5 repoquery DNF5 updates References
Daniels QEMU Standard PC _Q35 + ICH9, 2009_ MEle Intel® Celeron® N5105 × 4 F38 WS Linux 6.2.2-301.fc38.x86_64 Gnome 44.beta KVM
Pass pass
[1]
  1. ↑ Cool Stuff: All pass for "Sanity" test.
Gyro Fedora 38 test image inside virt-manager
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Gyro Fedora 38 test image inside virt-manager on Fedora 37
Pass pass
Renault x86_64 on Intel i5-3470 processor + nVidia 1050; fr_FR
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
VladimirSokolenko QEMU emulator version 6.2.0 (qemu-6.2.0-17.fc36), Fedora-Workstation-Live-x86_64-38-20230306.n.0.iso VM image
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Warning warn
[1]
  1. ↑ After successful package downgrade & next update process: sudo dnf5 update gedit Unknown argument "update" for command "dnf5" However, sudo dnf5 upgrade gedit works totally fine
alciregi Fedora Server aarch64 on Raspberry Pi 4
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
andilinux F38 Beta, Gnome Boxes, en_US, x86_64, Fresh Kernel 6.2.6-300.fc38.x86_64
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
bittin F38 Beta - Virtualbox
Warning warn
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Warning warn
[1]
Pass pass
  1. ↑ [fedora38beta@fedora ~]$ dnf5 repoquery --info vim Updating and loading repositories: Repositories loaded. guess this is not expected
bittin F38 Last Pre Beta - Virtualbox
Fail fail
[1]
Pass pass
Pass pass
Pass pass
Pass pass
  1. ↑ having problems with dnf5 reinstall and download --resolve
condor HP Elite 8300 w/ i5-3470
Pass pass
danniel F38, Libvirt VM
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
emanuelec VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
[1]
  1. ↑ Used VM upgraded from v37
emanuelec VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
emrakova OpenStack virtual machine, x86_64
Warning warn
[1]
Pass pass
Warning warn
[2]
Warning warn
[3]
Warning warn
[4]
Pass pass
[5]
  1. ↑ RHBZ #2178126 bash-completion doesn't work at all for dnf5-5.0.6-2.fc38, it works OK for dnf5-5.0.7-20230314005057.17.g160033cc.fc38 bug reported for dnf5 download
  2. ↑ alias dsync does not work for dnf5
  3. ↑ RHBZ #2178129 bug reported for dnf5 swap
  4. ↑ dnf5 repoquery provides duplicates when the same versions of packages are available in multiple repos, see also https://bugzilla.redhat.com/show_bug.cgi?id=2178126
  5. ↑ just missing update alias
ewilcox
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
  1. ↑ All tests resulted n the expected outcome as per the test page.
  2. ↑ All tests returned the expected outcome.
  3. ↑ All tests succeeded.
geraldosimiao F38 KDE beta 1.3 - x86_64 KVM virt-manager UEFI (running on F37 KDE at Acer Aspire V3-571 / i7-3632QM)
Pass pass
[1]
Pass pass
Pass pass
Pass pass
[2]
Pass pass
Warning warn
[3]
  1. ↑ dnf5-5.0.6-2.fc38.x86_64
  2. ↑ Swaped correctly sddm-wayland to sddm-x11 including upgrade of sddm in same transaction.
  3. ↑ At version dnf5-5.0.6-2 there is no "update" alias, only "upgrade". Using dnf5 upgrade all runs fine, without errors.
gianmichele Fedora 38 KDE with updates testing enabled
Warning warn
[1]
  1. ↑ The downloaded rpm's in /var/cache/libdnf5/<repo>/packages are not removed after operation and might fill up the partition without users consent. Output in console is very verbose compared to dnf4. "dnf5 upgrade" usually needs more than the the lines of a 1920 x 1200 tty screen.
hricky Bare Metal, ASRock H97 Pro4-P2.10, Intel® Core™ i7-4790 × 8, 32.0 GiB RAM, Intel® HD Graphics 4600 (HSW GT2), Fedora Linux 38 (Workstation Edition Prerelease), Kernel: Linux 6.2.5-300.fc38.x86_64
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
jdg216
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
lbrabec F38 QEMU VM aarch64
Pass pass
Pass pass
Pass pass
lruzicka F38, fully updated, Libvirt VM
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
markr217 kvm, 16G, 4 proc
Pass pass
markr217 kvm, 16G, 4 proc, F38
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
mbanas virtual F38, aarch64.
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
[1]
  1. ↑ Just the issue with update vs. upgrade.
mikelo2 podman + Raspberry Pi 3 Model B+
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
msmafra https://discussion.fedoraproject.org/u/msmafra/summary
Warning warn
[1]
  1. ↑ I've been running dnf5 since F38 branched, today of all days, sudo dnf5 upgrade or distro-sync did not work. "Transaction failed: Rpm transaction failed" After looping with sudo dnf5 distro-sync to each individual package evince was the culprit, all other package installed without warning
mzink F38 VM
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
rai510 Gnome Boxes Fedora-Workstation-Live-x86_64-38-20230313.n.0.iso
Pass pass
[1]
  1. ↑ All PASS
royboy626 Fedora 38 Beta Workstation;Bare Metal; x86_64;ZBOXHD-ND22
Pass pass
[1]
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
  1. ↑ Perhaps man page should state 'download' is to pwd?
sgob Fedora 38 in a VM, virt-manager.
Warning warn
[1]
Pass pass
  1. ↑ Everything went fine and smooth, installing and upgrading thousands of packages. However, for instance, when installing lots of packages, lowest completion bar always reports 100%. I installed texlive-scheme-full to test it.
urtabajev i3-3220T | 8GB
Pass pass

Parity Tests[edit]

User Profile DNF5 info DNF5 list DNF5 history DNF5 enable/disable repo DNF5 search DNF5 check-update DNF5 assorted options References
Renault x86_64 on Intel i5-3470 processor + nVidia 1050; fr_FR
Pass pass
[1]
Fail fail
[2]
Pass pass
[3]
Fail fail
[4]
Fail fail
[5]
Fail fail
[6]
Pass pass
  1. ↑ dnf5 info does not exist, used dnf repoquery --info instead
  2. ↑ dnf5 list does not exist
  3. ↑ List only transactions done with dnf5, not with dnf (and vice versa)
  4. ↑ dnf5 config-manager command does not exist, but being able to enable / disable repo for a specific transaction with --enablerepo argument...
  5. ↑ No available command dnf5 search
  6. ↑ No available command for dnf5 check-update
bittin F38 Beta - Virtualbox
Pass pass
Pass pass
[1]
Pass pass
Pass pass
[2]
Fail fail
[3]
Fail fail
[4]
Pass pass
Pass pass
Pass pass
Warning warn
[5]
Fail fail
[6]
  1. ↑ Works with the version in copr
  2. ↑ Works with the version in copr
  3. ↑ no undo or rollback
  4. ↑ Rollback is having problems
  5. ↑ Not implemented yet
  6. ↑ Unknown argument "check-update" for command "dnf5"
bittin F38 Pre Beta & Beta - Virtualbox
Fail fail
[1]
  1. ↑ [fedora38beta@fedora ~]$ sudo dnf5 config-manager --disable updates-testing Unknown argument "config-manager" for command "dnf5"
emanuelec VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
Pass pass
emanuelec VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
Warning warn
[1]
Warning warn
[2]
Pass pass
[3]
Warning warn
[4]
Warning warn
[5]
Warning warn
[6]
  1. ↑ dnf info dnf works (as per test), but dnf5 info dnf doesnt exist
  2. ↑ dnf list works (as per test), but dnf5 list doesnt exist
  3. ↑ List only transactions done with dnf5, not with dnf (and vice versa)
  4. ↑ dnf5 config-manager command does not exist
  5. ↑ No available command dnf5 search
  6. ↑ No available command for dnf5 check-update
ewilcox
Pass pass
Pass pass
Pass pass
[1]
Warning warn
[2]
Warning warn
[3]
Warning warn
[4]
Fail fail
[5]
  1. ↑ --info and --last are not recognized arguments. dnf returned the usage: dnf history output.
  2. ↑ both 'sudo dnf config-manager --disable fedora-modular' and 'sudo dnf config-manager --enable fedora-modular' execute reporting no error. They display no confirmation message that the repository has been enabled or disabled. The only indication of success is that following execution the terminal returns to the command prompt.
  3. ↑ Expected Results for dnf search nemo: The following must be true to consider this a successful test run: The command executes without error. true The output includes a list of packages that match the search criteria, sorted alphabetically. true Each package listed should include the package name, a brief description, the version number, and the repository from which it is available. false (ncludes pacage name : descirption) The output is readable and formatted correctly. true
  4. ↑ Expected Results The command executes without error: true The output includes a list of available package updates, if any, sorted by package name: none available Each package listed should include the package name, the current version, the available version, the repository from which it is available, and a brief description of the update: none listed If there are no available package updates, the output should indicate that no updates are available: false - no indication that no updates are available. The output is readable and formatted correctly: true
  5. ↑ All dnf commands complete without error: false - sudo dnf install -y --enablerepo=epel --best nginx Error: Unknown repo: 'epel' The nginx, git, python3, and vim packages are installed successfully: true The nodocs option is enabled for the nginx installation: true The epel repository is disabled during the git installation and enabled during the nginx installation: false sudo dnf install -y --enablerepo=epel --best nginx Error: Unknown repo: 'epel' The latest version of nginx is installed during the nginx installation: false sudo dnf install -y --enablerepo=epel --best nginx Error: Unknown repo: 'epel' The $releasever value is overridden during the python3 installation: false Package python3-3.11.2-1.fc38.x86_64 is already installed. The keepcache option is set to 1 during the vim installation: false Package vim-enhanced-2:9.0.1367-1.fc38.x86_64 is already installed.
geraldosimiao F38 KDE beta 1.3 - x86_64 KVM virt-manager UEFI (running on F37 KDE at Acer Aspire V3-571 / i7-3632QM)
Warning warn
[1]
Pass pass
[2]
Fail fail
[3]
Fail fail
[4]
Warning warn
[5]
Fail fail
[6]
Pass pass
[7]
Warning warn
[8]
  1. ↑ dnf5 have only "dnf5 repoquery --info <package>" and dnf have both methods (info and repoquery).
  2. ↑ dnf5 list command works fine with unstable version 5.0.7-20230315005850.23.g520edcb2 from copr
  3. ↑ No dnf5 list with version 5.0.7-1 from rawhide.
  4. ↑ no dnf5 list
  5. ↑ Both work almost the same way but when we run dnf history info, dnf by default return the last transaction, no need to use the transaction number. DNF5 don't do this, it return nothing, one must use the transaction number always.
  6. ↑ yeah, no config-manager plugin for dnf5 yet.
  7. ↑ With version 5.0.7-1 from rawhide "search" command worked just fine
  8. ↑ dnf5 don't have search yet, using dnf5 repoquery <package> solve this
jdg216
Pass pass
Warning warn
[1]
Warning warn
[2]
  1. ↑ dnf test ok, but dnf5 doesn't exist
  2. ↑ dnf history works, but dnf5 needs: dnf history list
lruzicka F38, fully updated, Libvirt VM
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Fail fail
[4]
Pass pass
[5]
Fail fail
[6]
Pass pass
  1. ↑ I am using the unstable version from the COPR
  2. ↑ unstable COPR version
  3. ↑ dnf history shows help and requires additional arguments to be used
  4. ↑ The config-manager subcommand does not exist for me.
  5. ↑ Using the unstable COPR version.
  6. ↑ Subcommand does not exist.
markr217 kvm, 16G, 4 proc, F38
Pass pass
Pass pass
Pass pass
Fail fail
[1]
Pass pass
Pass pass
Pass pass
  1. ↑ 4. dnf config-manager --disable <repository-name> (and --enable ) works fine. dnf enable/disable failed with: No such command: enable/disable. Please use /usr/bin/dnf --help It could be a DNF plugin command, try: "dnf install 'dnf-command(enable/disable)'"
    • Note: setup for this test specifies bare metal, I was using a kvm.
mikelo2 podman + Raspberry Pi 3 Model B+
Pass pass
Pass pass
mzink F38 VM
Pass pass
Pass pass
Pass pass
Warning warn
[1]
Pass pass
Fail fail
[2]
Pass pass
  1. ↑ dnf5 doesn't have the ability to enable/disable repo yet. dnf & dnf5 repolist is in sync when you enable/disable repo and compare the list.
  2. ↑ sudo dnf5 check-update Unknown argument "check-update" for command "dnf5" I assume this is expected. Dnf5 is still under development and does not have all dnf subcommands/parameters.
royboy626 Fedora 38 Beta Workstation;Bare Metal; x86_64;ZBOXHD-ND22
Warning warn
[1]
Pass pass
[2]
Warning warn
[3]
Warning warn
[4]
Warning warn
[5]
Warning warn
[6]
Warning warn
[7]
  1. ↑ Assume command should be: 'dnf5 repoquery --info <package-name>' Assuming that: [PASS]
  2. ↑ 'dnf list' [PASS]; 'dnf5 list does not exist
  3. ↑ 'dnf history' [PASS]; dnf5 history not available
  4. ↑ dnf config-manager <repository-name. [PASS]; dnf5 config-manager unavailable
  5. ↑ 'dnf search <package-name. [PASS]; 'dnf5 search' unavailable
  6. ↑ 'dnf check-update' [PASS]; dnf5 check-update unavailable
  7. ↑ tests names (Ex. dnf5 history) in 'Parity Tests' section should match the commands within the tests (dnf history)

Exploratory Testing[edit]

User Profile Exploratory Testing References
bittin F38 Beta - Virtualbox
Pass pass
bittin F38 Pre Beta & Beta - Virtualbox
Pass pass
[1]
  1. ↑ Upgraded the system with sudo dnf5 distro-sync worked good even with 300+ packages :)
msmafra Fedora 38 updated 2023-02-14
Fail fail
[1]
  1. ↑ dnf5 did not remove unused dependencies: ❯ doas dnf5 remove evince Removes evince and says Removing unused dependencies: evince-previewer, evince-thumbnailer ❯ doas dnf5 install evince evince-thumbnailer evince-previewer Package "evince-thumbnailer-44~rc-1.fc38.x86_64" is already installed. Package "evince-previewer-44~rc-1.fc38.x86_64" is already installed.
msmafra https://discussion.fedoraproject.org/u/msmafra/summary
Warning warn
[1]
  1. ↑ dnf5 doesn't have some commands like search, and makecache and subcommands installed and userinstalled for the history command, for example. It only has: install, upgrade, remove, distro-sync, downgrade, reinstall, swap, mark, repoquery, group, environment, module, history, repo, advisory, groupinfo, grouplist, repoinfo, repolist, updateinfo, upgrade-minimal, clean, download, makecache, builddep, changelog
mzink F38 VM
Warning warn
[1]
  1. ↑ dnf5 does not have all dnf subcommands. For example: dnf update - works dnf5 update - unknown command
urtabajev i3-3220T | 8GB
Fail fail
[1]
  1. ↑ sudo dnf5 upgrade --enablerepo=updates-testing reports - "Nothing to do." sudo dnf update --enablerepo=updates-testing --refresh - "Upgrade 24 Packages"
Retrieved from "https://fedoraproject.org/w/index.php?title=Test_Day:2023-03-14_Fedora_38_DNF_5&oldid=674941"