Is anaconda broken proposal
From FedoraProject
.png){kind=small}
This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.
It is still under construction and content may change. Do not rely on the information on this page.
Contents |
Overview
provide small auto-test system with a web-based interface which can help to customize autoinstall testing.The test system should be small enough for personal use.
Problem Space
The purpose of auto test is to simplify testing,save time, improve efficiency.So the auto-test should help us to solve the following problems:
- the system should be small enough for personal use
- have a very simple interface for user to customize testing or configure testing
- very easy interface for user to set up some services due to some special cases,such as ftp/nfs/http install,etc
- test result is easy to check
Installation process covers the following sections, therefore, brokenness comes from these types:
- Image Sanity
- Error in size/Checksum
- Dependency problems/File Conflicts
- Versions check
- Boot Methods
- Anaconda fails to boot
- Anaconda unable to transition to stage#2
- Install Source
- Unable to find source
- Kickstart Delivery
- Ks.cfg couldn't be obtained from specified location
- Install fails to proceed in accordance with the directives in the ks.cfg file
- Package Set
- Process of package install doesn't complete
- Package errors (install.log)
- The specified packages aren't installed
- Partitioning
- Can't prompt for an existing partition to resize
- Error when resizing the selected partition
- The installer fails to partition the system as required
- Encrypted partitions contain errors.
- User Interface
- Unable to boot to graphical/text mode
- Graphical anaconda displays error in steps
- Anaconda doesn't start Xvnc/telnet properly
- Recovery
- Rescue mode fails
- Anaconda doesn't prepare the updates.img
- Traceback errors
- Storage Devices
- Fail to detect any storage device
- Error occurred during installation
- Upgrade system
- upgrade issues.
- preupgrade issues.
Auto-test will test anaconda of these media:DVD,CDROM, LiveCD,Network boot CD.If anaconda broken,typically have these issues:
- DVD install
- Boot fails from DVD
- Stage#2 can not start successfully
- Partition fails
- Reboot to newly installed system fails
- Upgrade fails
- CDROM install
- Fail to boot from CDROM
- Stage#2 can not start successfully
- Fail to request next CDROM
- Package errors during installation
- Reboot to newly installed system fails
- BootCD install
- Fail to boot from BootCD
- kickstart install fails
- Ftp install fails
- NFS install fails
- Repo is missing
- Http install fails
- LiveCD install
- LiveCD install fails
- Reboot to newly installed system fails
Proposed Solution
- use virtual machine(libvirt+KVM) to finish install tests one by one.
- provide simple interface to customize testing.
- Create scripts to do test automatically for anaconda
- Create test cases for the above possible breakness of anaconda(DVD,CDROM,BootCD,LiveCD)
- Test result display page help to check the test result easily,the result format is good for testers to post to specified link(have no need to change a lot before post).
- Write test cases From simple to complex, kickstart to graphic.
Scope
- Any testers from community can install the testing system and run test cases
- After finish testing,testers will post test result to specified wiki
Active Ingredients
- develop a system to run install system
- convert some of the current install test cases to cases which can be run in auto test system
- Provide a test results presentation layer for manual test result submission
Roadmap
your comments
Results
Version 1.0
- Goal: Create a basic system, make it simple and run successfully.
- Case: DVD input and support simplest test cases.
- Platform: Virtual Machine.
- Inputs and Outputs:
- Inputs: DVD, kickstart files, python (shell) scripts.
- Outputs: Logs of whole process(including anaconda logs), test results.
- Approach<<Fix Me>>:
- Create a server, and prepare DVD.iso.
- Create a virtual machine by the server.
- Run test cases using some kickstarts for install tests.
- Send back some logs, successful or not...
- Have some "results parsers" which waits for the logs from the clients and then parses them
- Frameworks studied so far: kvm-autotest, autotest, libvirt, dogtail.
Version 2.0
- Graphical automation testing
- Useful links
- http://libvirt.org/
- http://jlaska.livejournal.com/tag/cobbler
- GUI automation
- http://www.linux-kvm.org/page/KVM-Autotest
- The above autotest is based on this framework: http://autotest.kernel.org/
- The steps to work with step files: http://www.linux-kvm.org/page/KVM-Autotest/Steps
Discussion Points
your comments
Comments?
To leave a comment, use the Talk page for this proposal.
Owner
Fedora auto-install test project
Meeting
This project meeting is held weekly for progress. Welcome everyone to attend it and give your valuable suggestions.
- IRC on #fedora-meeting
- Each Friday at 8:30 UTC (9:30 CET and 16:30 Bejing)
