[Fedora QA] #476: Proposed Test Day - Cinnamon Spin

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
----------------------+------------------------
 Reporter:  grinnz    |       Owner:
     Type:  task      |      Status:  new
 Priority:  major     |   Milestone:  Fedora 23
Component:  Test Day  |     Version:
 Keywords:            |  Blocked By:
 Blocking:            |
----------------------+------------------------
 It would be awesome if the QA team could setup a test day for the new
 Cinnamon spin. I don't have a preference on the date.

https://fedoraproject.org/wiki/Changes/Cinnamon_Spin

[Giulio E.]

Il 17/Lug/2015 01:11, "Fedora QA"  ha scritto:
> #476: Proposed Test Day - Cinnamon Spin
> ----------------------+------------------------
>  Reporter:  grinnz    |       Owner:
>      Type:  task      |      Status:  new
>  Priority:  major     |   Milestone:  Fedora 23
> Component:  Test Day  |     Version:
>  Keywords:            |  Blocked By:
>  Blocking:            |
> ----------------------+------------------------
>  It would be awesome if the QA team could setup a test day for the new
>  Cinnamon spin. I don't have a preference on the date.
>
> https://fedoraproject.org/wiki/Changes/Cinnamon_Spin
>
> --
> Ticket URL: https://fedorahosted.org/fedora-qa/ticket/476
> Fedora QA http://fedorahosted.org/fedora-qa
> Fedora Quality Assurance
> --
> test mailing list
> [e-mail]
> To unsubscribe:
> https://admin.fedoraproject.org/mailman/listinfo/test

This was also dicussed in a recent meeting and, as said there, it will be a
great chance to engage people for testing.

We might also discuss about the modality: since the standard test cases
will be tested by us during release validation, I'd rather write a call for
a sort of exploratory testing. Increasing people's freedom with the
flexibility of exploratory testing, we might receive a broader coverage.

My idea is to include a reference to the standard testcases inside the wiki
page, but not to flag them as mandatory during the TestDay, in order to get
some exploratory efforts.

What do other QA folks think about it?
Have a nice day

---
Giulio (juliuxpigface)

[Kamil Paral]

> This was also dicussed in a recent meeting and, as said there, it will be a
> great chance to engage people for testing.
> We might also discuss about the modality: since the standard test cases will
> be tested by us during release validation, I'd rather write a call for a
> sort of exploratory testing. Increasing people's freedom with the
> flexibility of exploratory testing, we might receive a broader coverage.
> My idea is to include a reference to the standard testcases inside the wiki
> page, but not to flag them as mandatory during the TestDay, in order to get
> some exploratory efforts.
> What do other QA folks think about it?

You can also add a test case saying something like "try a few random things". That makes it obvious that random exploratory testing is very welcome and that people should not be focused on just the few prepared test cases.

Btw, will we have some Cinnamon developers on board?

[Adam Williamson]

On Fri, 2015-07-17 at 08:25 +0200, Giulio (juliuxpigface) wrote:
> Il 17/Lug/2015 01:11, "Fedora QA"  ha scritto:
> > #476: Proposed Test Day - Cinnamon Spin
> > ----------------------+------------------------
> >  Reporter:  grinnz    |       Owner:
> >      Type:  task      |      Status:  new
> >  Priority:  major     |   Milestone:  Fedora 23
> > Component:  Test Day  |     Version:
> >  Keywords:            |  Blocked By:
> >  Blocking:            |
> > ----------------------+------------------------
> >  It would be awesome if the QA team could setup a test day for the 
> > new
> >  Cinnamon spin. I don't have a preference on the date.
> >
> > https://fedoraproject.org/wiki/Changes/Cinnamon_Spin
> >
> > --
> > Ticket URL: https://fedorahosted.org/fedora-qa/ticket/476
> > Fedora QA http://fedorahosted.org/fedora-qa
> > Fedora Quality Assurance
> > --
> > test mailing list
> > [e-mail]
> > To unsubscribe:
> > https://admin.fedoraproject.org/mailman/listinfo/test
>
> This was also dicussed in a recent meeting and, as said there, it 
> will be a
> great chance to engage people for testing.
>
> We might also discuss about the modality: since the standard test 
> cases
> will be tested by us during release validation, I'd rather write a 
> call for
> a sort of exploratory testing. Increasing people's freedom with the
> flexibility of exploratory testing, we might receive a broader 
> coverage.
>
> My idea is to include a reference to the standard testcases inside 
> the wiki
> page, but not to flag them as mandatory during the TestDay, in order 
> to get
> some exploratory efforts.
>
> What do other QA folks think about it?
> Have a nice day

Sure, this is a very good approach. There's no such thing as
'mandatory' for a test day really :), but we've often had ones where we
list some test cases and also explicitly ask for exploratory testing
and provide a space for reporting the results.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:
      Type:  task      |     Status:  new
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by adamwill):

Sure, we'd love to help! Right now we have test days scheduled for 08-18,
 08-20 and 09-01, so if you have no preference as to the date, perhaps
 08-27? That's right in the 'sweet spot' between Alpha and Beta.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:
      Type:  task      |     Status:  new
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by grinnz):

Sounds good to me!

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:
      Type:  task      |     Status:  new
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by adamwill):

So I'm sorry to catch this so late, but in fact we wound up scheduling the
 Cloud Test Day for 08-27. Would it be OK to move this event to the
 following Thursday, 09-03? Thanks!

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:
      Type:  task      |     Status:  new
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by grinnz):

Sure, no problem.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:  adamwill
      Type:  task      |     Status:  assigned
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------
Changes (by adamwill):

* status:  new => assigned
 * owner:   => adamwill

Comment:

OK! I added it to the calendar:

https://apps.fedoraproject.org/calendar/list/QA/?subject=Test+Day

and created a page:

https://fedoraproject.org/wiki/Test_Day:2015-09-03_Cinnamon

the page just has the template contents for now, we'll have to clean it up
 and add all the necessary details and tests.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:  adamwill
      Type:  task      |     Status:  assigned
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by adamwill):

So I moved it to:

https://fedoraproject.org/wiki/Test_Day:2015-10-04_Cinnamon

since we totally forgot to get it ready for 09-03. Damn, but I'm good at
 this. I'll promise to do it this time! honest.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:  adamwill
      Type:  task      |     Status:  assigned
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by adamwill):

OK, page content updated and results table added, now just really needs
 publicity and a link to the live ISOs adding closer to the date.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:  adamwill
      Type:  task      |     Status:  assigned
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by adamwill):

I have no idea where I got 10-04 from, obviously wasn't aiming for a
 weekend. Think I meant 10-08. I'll move it one more time :/ sorry for the
 mess-ups.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:  adamwill
      Type:  task      |     Status:  assigned
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by grinnz):

Haha, I had forgotten about it also. Thanks for rescheduling.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:  adamwill
      Type:  task      |     Status:  assigned
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:            |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------

Comment (by adamwill):

Test day ran successfully, thanks everyone! Stats:

{{{
 Test Day:2015-10-08 Cinnamon
 Testers: 11, Tests: 77, Bugs: 5, Ratio: 0.454545454545
 Open: 2, Dupe: 1, Fixed: 1, Unfixed: 1, Fixed %: 25.0
 }}}

If you'd like to have another event for F24, please file a new ticket.

[fedora-badges]

#476: Proposed Test Day - Cinnamon Spin
-----------------------+-----------------------
  Reporter:  grinnz    |      Owner:  adamwill
      Type:  task      |     Status:  closed
  Priority:  major     |  Milestone:  Fedora 23
 Component:  Test Day  |    Version:
Resolution:  fixed     |   Keywords:
Blocked By:            |   Blocking:
-----------------------+-----------------------
Changes (by adamwill):

* status:  assigned => closed
 * resolution:   => fixed