Compatibility/Meetings/Sync w Honza

September 06 2022

Cases where the "lock icon" shows a message like "Parts of the page are not secure" (SV)

In the past, we have treated issues where inside the lock icon from the URL bar stated that parts of the page are not secured or not working, as valid webcompat issues. How should we treat similar issues from now on?

Context: https://github.com/webcompat/web-bugs/issues/109640

honza: treat them as non-compat, but better ask dennis about it (for mixed content issues)

dennis: That happens when a site served via encrypted https:// is loading an asset, like an image, over unencrypted http://. This is a small security risk, which is why browsers warn you. However, this is just a warning, Firefox will still load and display the "insecure" image either way. So from our point of view, nothing is broken in most cases. It only becomes a WebCompat bug if something is actually broken on that site, for example if images are missing. In theory, Chrome will show the same warning. However, this became a lot more confusing recently, as Chrome is now shipping an automagic upgrade mechanism. If Chrome encounters mixed content, Chrome will try to load the image via https://, and only warn if that fails. So you generally don't see this warning in Chrome anymore

Accounts/access for Calin (SV)

As far as I know LDAP account was requested already for Calin. For webcompat, he already has an account, but he needs rights to be able to change the status of issues/add labels etc.

Oana: is it possible for Calin to get access?

Honza: working on it

Oana: but for Github, he needs to be added to the repository.

Honza: I will do it.

Repositories: - https://github.com/webcompat

- https://github.com/mozilla

Browser feature issues that are reproducible for one page only, working as expected on other pages(SV)

Are issues like this classed as valid Compatibility issues, or valid browser issues? For example, more saved login infos are shown (3) for walmart.com, instead of just the login info for walmart. Facebook for example shows just the login info for Facebook, without showing other saved login infos for other pages.

Context: https://github.com/webcompat/web-bugs/issues/110278

honza: indeed it might be a browser feature, but we can't fully know for sure, so move them to Needsdiagnosis and they will be checked at the Fast Triage meeting

QA Trends (Honza)

Most encountered issues at triage:

- YouTube videos not playing - reproduced by Calin and Raul

- Twitch videos - videos are not displayed in dark mode - fix is available for Firefox Nightly

- Print preview issues - broken layout

honza: continue adding qa trends

August 23 2022

DevTool - Remote Debugging tablet (SV)

Unable to see Inspect panel on a tablet device (empty screen shown), even if connection to the device was established. (USB debugging is enabled both in Firefox and in the device system) https://prnt.sc/f4ubd-5H54QX

Sometimes an error is shown https://prnt.sc/lwn7JAju04t9

Honza: Let's keep this topic for the next meeting.

Oana: [Update] it works now

Notes:

• If this happens again:

   * There is #devtools and #devtools-team slack channel
   * The best person to talk to: @jdescottes

ETP issues and caching (SV)

Some sites are broken due to ETP (usually Strict), but after disabling and enabling it again, the issue no longer reproduces.

E.g. https://github.com/webcompat/web-bugs/issues/109139 (https://www.mpecopark.co.uk/)

Workaround: clearing cache, the issue reproduces again with ETP - Strict.

This probably needs some investigation on the ETP side, while changing states cache should be cleared.

Should we continue reporting the issues in Bugzilla as we did before and add a note regarding the cache problem?

honza: talk to Tom, and ad the topic to the Webcompact meeting agenda, and file a Bugzilla bug if there is none (with details, and examples)

July 26 2022

QA Documentation added to Mana page (SV)

https://mana.mozilla.org/wiki/display/QA/WebCompat+team+documents

Honza: Cool, thanks for that.

OKR Triage Trends (SV)

We've added some topics to the OKR https://github.com/mozilla/webcompat-team-okrs/issues/262

Raul: Observing duplicate issues that were not reproducible at the time, as per: https://github.com/webcompat/web-bugs/issues/106716, where we observed a pattern, helped us to reproduce an issue that affected numerous users following the Trend guideline.

What is a Trend? (SV)

We summarized some ideas:

- something that occurs on most used/popular sites
- duplicate issues 
- unsupported features on Firefox 
- unable to sign in with FB/Google/Twitter with ETP - Strict enabled
- embedded media content not displayed with ETP - Strict enabled

Honza: yes, these points summarize the idea of the Trend, and what to look for when observing a Trend. I would also add a page not working in certain parts of the world.

[FYI] Incompat ad-on (SV)

https://addons.mozilla.org/en-US/firefox/addon/incompat/?utm_source=addons.mozilla.org&utm_medium=referral&utm_content=search

This addon is a companion for https://webcompat.com. It helps track compatibility bugs for sites and shows you the number of already reported bugs on that domain.

Honza: Does this add-on show Duplicate issues?

Raul: Yes, it creates a list of all the issues signaled regarding the URL submitted. All the reports are shown via a GitHub search query made by the-addon

Honza: Does it help you in your daily triage?

Raul: Very much. It helps identify duplicates faster and easier, or other related issues with the reported issue.

DevTool - Remote Debugging tablet (SV)

Unable to see Inspect panel on a tablet device (empty screen shown), even if the connection to the device was established. (USB debugging is enabled both in Firefox and in the device system) https://prnt.sc/f4ubd-5H54QX

Sometimes an error is shown https://prnt.sc/lwn7JAju04t9

Honza: Let's keep this topic for the next meeting.

Priority vs severity labes (Honza)

Honza: I've seen that you use labels to set severity and priority. How does that work?

Raul: Once an issue is reproducible, we move it to the Needsdiagnosis milestone, where we set the default label for priority to normal, and the severity label accordingly.

Honza: How do you set the priority level via the label?

Raul: Based on the impact the signaled issue has, we have 3 levels for the severity label: minor, important, and critical.

- minor- for cosmetical issues on the page
- important- a non-core broken piece of functionality
- critical- the page or core functionality is unusable, or you would probably open another browser to use it.

Honza: Who sets the labels?

Raul: The priority is set during the diagnosis process, while the severity is set in the triage process.

DevTools for QA guidelines document (SV):

https://docs.google.com/document/d/1LiRE6crZ4sSzzxvU3Xkjg410bQ6-5h2b7nivetMl4ek/edit

Honza: Thanks for that, that is very helpful.

July 12 2022

Q3 Planning done (SV)

We've created the tasks and added them to 2022H2 dashboard. https://github.com/mozilla/webcompat-team-okrs/projects/16

Oana: If you consider adding other tasks, please let us know.

Honza: How does Site Interventions Release work? Is it like testing every Release intervention?

Oana: Yes, that is correct.

Issue reported with features unsupported on Firefox (SV)

We get issues where some features are not supported on Firefox but are supported on other browsers.

There are many times where we can't create a test account or the STR are not clearly provided, so we are unable to verify them.

Based on the info/description/screenshot provided by the user, should we move them to Needsdiagnosis or maybe directly to Needscontact, so the team would contact the site owner to understand why those features are not supported in Firefox?

e.g https://github.com/webcompat/web-bugs/issues/107210

Honza: If it's the second case, we can move it to NeedsContact, and if we do not have an account, we should move it to NeedsDiagnosis, because we can ask around if we can get an account to test.

Interventions/UA Overrides QA verification guidelines manual+automation (SV)

Ref: https://docs.google.com/document/d/1WCKizeFjR_125FMmEySPAjjSSkEmimUrXvwnoyIhE9E/edit?usp=sharing

Honza: Do we have a list of the already made documents? I know this is not the first time you have made such a document, which is super-helpful.

Oana: We can make one, sure.

Honza: We also have the Mana Page: https://mana.mozilla.org/wiki/pages/viewpage.action?spaceKey=FIREFOX&title=WebCompat, can we add it here?

Oana: Sure, we can add it here.

Honza: Can you quickly summarize this document for me?

Oana: ofc, there is a bit of info about Interventions/UA Overrides, how we can see it based on different devices, how to enable or disable them, and a section about manual and automation testing.

Oana: If one of the Webcompat issue is reproducible, the Intervention/UA Override is still needed. If not, we create a Bugzilla task to remove the Intervention/UA Override.

Honza: When you test if an Intervention/UA Override is needed, do you go through a list?

Oana: Yes, Dennis created a dashboard where we have the necessary data.

Honza: I see you build the gecko driver as well. Is that needed?

Oana: Yes, that is needed for the automation set-up in order to run the tests in Firefox

Honza: Sounds cool, please share this document in the next Webcompat meeting.

Honza: What happens if there are too many failed automation tests?

Oana: We run them one by one.

Oana: For the moment, the automation tests are just for the desktop issues.

Trends/patterns (Honza)

One of our goals is to spot trends in WebCompat landscape.

Honza: We have a list of tasks to be completed. This should help us recommend to the team what are the top of the webcompat issues, which are important, which are not.

There are different perspectives regarding this (how many users are using the page, etc).

We have recommendations to the platform team, so that they can focus on them.

The second part is trends, and about spotting them. So, what is a trend?

A trend might be that a page does not work in Firefox, in some parts of the world (unknown issues). Or other browsers are implementing APIs, except for Firefox (doing something without us- future issues).

Oana: The second example of the trend can be observed in Interventions/Overrides

Honza: Exactly. The third case of a trend is known webcompat issues.

So as you are doing triage, you might be able to spot trends. Maybe you can see some patterns. Is that something you can help us?

Raul: Should we focus on reproducible issues reported by users, or Worksforme issues?

Oana: Usually we move issues that we can not reproduce to Worksforme.

Honza: Writing them down, regardless of their status, as long as the issues present a pattern/trend, we can write them down.

Is this possible to summarize this kind of issue?

Oana: We can make a document to summarize this.

Honza: Great, let's try this.

Raul: Here we have an issue that might be classed as a trend. Should we mention future issues inside related issues, like we did here?

https://github.com/webcompat/web-bugs/issues/106716

Honza: Sure.

Oana: Can we make an OKR task out of this, eg. Triage Trends?

Honza: Sure.

Oana: I've created the OKR task and added a few items:

https://github.com/mozilla/webcompat-team-okrs/issues/262

DevTools (Honza)

How much DevTools is useful/needed for triage?

Oana: We use the Inspector to pin-point the affected area of the code, or we play around with the CSS where possible to see if a possible fix can be applied, and we also use it for RDM.

Honza: For the next time, I will put again this item in the agenda, so we can talk more about this, and what we can use to improve DevTools for everybody.

Oana: Also, I've seen something about the Compatibility panel. We hardly use this. Also the screenshot feature.

Honza: We will talk about this as well.

Oana: Reporting issues from the DevTools, how will this work? Will it be implemented?

Honza: This is a suggestion, we have not agreed on yet.

Oana: We also use Remote Debugging for Android? We have some ideas there for improvements, as we guide users sometimes to use this, and we also use them.

Honza: Sure, we can talk about what we can improve here as well.

Oana: Also, we use the performance tab of the DevTools, and the Network tab.

Honza: Cool, highlight this in a document regarding how, what and why you use DevTools in your triage process.

June 27 2022

Verification of shipped Intervention/UA Override (Honza)

honza: as discussed on slack with Dennis, I was wondering about the process from your point of view as to what is happening around every cycle of shipped Interventions/ Overrides

oana: at each cycle, 2 weeks before the release date, we perform a verification, both manually and automatically, for the list of the Inverventios/Overrides.

We check with both the Interventions/Overrides enabled/disabled, and based on the results, we conclude if the Interventions/Overrides are needed or not.

If the issue is no longer reproducible with the Interventions/Overrides disabled, we will submit a Bugzilla report to request the removal of the issue from the list.

honza: I have seen that some Bugzilla reports for Interventions/Overrides have a corresponding GitHub issue.

oana: some of them have a corresponding GitHub issue because they were first signaled using Webcompat reporter, and they are added to the "See Also" field in order to give context when investigating.

honza: is there a list regarding the Interventions/Overrides?

oana: We have a list we use, created by Dennis https://webcompat-interventions-dashboard.0b101010.services/

but also in `about:compat`, we can see the active Interventions/Overrides that are in place and their corresponding Bugzilla task.

oana: at each run, we create our own list (containing both the Bugzilla and the Github issue, add status and comments) https://docs.google.com/spreadsheets/d/1F9vcSpLQ_hNBeZinsytGXlfXpJLW6vh7C0BJYtd9hIY/edit?pli=1#gid=477077755

oana: we'll create an Intervention/UA Override guidelines document asap

June 14 2022

Firefox Release vs Firefox Nightly reproducibility (SV)

Currently, issues that are reproducible on Release but they are not reproducible on Nightly, we close them as Won't fix, with the message for the user to test on the next release.

We previously agree to this approach with Karl. Should we continue doing so?

honza: we can keep this approach

[FYI] Bug reported QA flow (SV)

We've created a chart and some guidelines on the work performed by SV QA team after a bug is reported on webcompat.com platform.

 Chart with the QA flow: https://drive.google.com/file/d/16Y3XwBIZArdySUvZAzcql8AiHetu5Sql/view?usp=sharing
 Guidelines - flow explained: https://docs.google.com/document/d/190-mh_vNzrso2RaEQ5OULii-YsN3d5sUt8AZVSOUH5A/edit?usp=sharing  

honza: can this be shared with Webcompat team?

oana: yes, I've created a copy for the team using a Mozilla account, everyone should have now access to view and comment

[Honza] WebCompat Repos

What is the relation and how the process looks like?

• [webcompat/web-bugs](https://github.com/webcompat/web-bugs)

• [webcompat/web-bugs-private](https://github.com/webcompat/web-bugs-private)

honza: we discussed it, all good

Fast Response Triage details (SV)

Are there any updates on this topic?

honza: things are moving, work in progress, I'll keep you updated

paul: this will be helpful since all the team members are working on it

May 31 2022

Welcome Honza

Introduction to webcompat. QA tasks.

Previous Sync meetings:

- Sync meetings with Karl

- Sync meetings with Mike