<?xml version="1.0" encoding="UTF-8"?><!-- generator="wordpress/wordpress-mu-1.2.3-2.2.1" -->
<rss version="2.0" 
	xmlns:content="http://purl.org/rss/1.0/modules/content/">
<channel>
	<title>Comments on: Quality Central November 2007 Revisit</title>
	<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893</link>
	<description>CodeGear QA Manager for RAD Studio products</description>
	<pubDate>Fri, 22 Aug 2008 03:21:46 +0000</pubDate>
	<generator>http://wordpress.org/?v=wordpress-mu-1.2.3-2.2.1</generator>

	<item>
		<title>By: Chris Pattinson</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-481</link>
		<author>Chris Pattinson</author>
		<pubDate>Fri, 16 Nov 2007 17:43:08 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-481</guid>
		<description>Hi m. Th,

Two key points come out of your discussions - information sharing, which is surprisingly difficult in the US now due to revenue recognition (my girlfriend who is a tax accountant is helping me understand the laws here), and then QC usage itself. QC started as a public self-support project 'skunkworks' by developer relations, which we're looking to enhance a great deal.

And not to discredit the hundreds of hours of work that resulted in over 10 000 issues reported in QC from being addressed! That's a really good success story. Even with it's weaknesses, QC is very usable and provides the team great information.

However, as it stands now - reports are coming in faster then CG internal staff can deal with them, and we need more active Sysops. Sysops will look into the areas they are interested, and the areas they are not will get neglected. 

Voting help prioritize work, and limited votes focuses on the important issues - however for the serious but not very high profile issues, the small number of votes did not provide needed granularity. 

I've taken samples of hundreds of QC reports in various areas, and a large number have 0 votes, a few have 1 to 5 votes, and a small number have over 5. Hence the directive to increase maximum number of votes to see if we can get more general feedback and create something closer to a bell curve. 

As to solving the information problem - the basic 'is codegear looking at it?' - if it's Open, it's on our radar. Then it's prioritized, which is the hard part right now with such limited voting feedback. 

So recent changes will help to address those two major issues. We still can't ever say 'this list of bugs are what we're planning to fix in an update' - we do those discussions with our internal field test, which are under NDA. 

Now, we're fairly casual about who we let into our field test - anyone who wants to install the latest patch or build, which is usually a beta quality by the time we release to field test, can send me an email and ask to join. I'm usually fairly communicative and open with the internal field test. It's much safer then worrying about SOX or revenue recognition by some inferred promise (as much as folks would like to hear it).</description>
		<content:encoded><![CDATA[<p>Hi m. Th,</p>
<p>Two key points come out of your discussions - information sharing, which is surprisingly difficult in the US now due to revenue recognition (my girlfriend who is a tax accountant is helping me understand the laws here), and then QC usage itself. QC started as a public self-support project &#8217;skunkworks&#8217; by developer relations, which we&#8217;re looking to enhance a great deal.</p>
<p>And not to discredit the hundreds of hours of work that resulted in over 10 000 issues reported in QC from being addressed! That&#8217;s a really good success story. Even with it&#8217;s weaknesses, QC is very usable and provides the team great information.</p>
<p>However, as it stands now - reports are coming in faster then CG internal staff can deal with them, and we need more active Sysops. Sysops will look into the areas they are interested, and the areas they are not will get neglected. </p>
<p>Voting help prioritize work, and limited votes focuses on the important issues - however for the serious but not very high profile issues, the small number of votes did not provide needed granularity. </p>
<p>I&#8217;ve taken samples of hundreds of QC reports in various areas, and a large number have 0 votes, a few have 1 to 5 votes, and a small number have over 5. Hence the directive to increase maximum number of votes to see if we can get more general feedback and create something closer to a bell curve. </p>
<p>As to solving the information problem - the basic &#8216;is codegear looking at it?&#8217; - if it&#8217;s Open, it&#8217;s on our radar. Then it&#8217;s prioritized, which is the hard part right now with such limited voting feedback. </p>
<p>So recent changes will help to address those two major issues. We still can&#8217;t ever say &#8216;this list of bugs are what we&#8217;re planning to fix in an update&#8217; - we do those discussions with our internal field test, which are under NDA. </p>
<p>Now, we&#8217;re fairly casual about who we let into our field test - anyone who wants to install the latest patch or build, which is usually a beta quality by the time we release to field test, can send me an email and ask to join. I&#8217;m usually fairly communicative and open with the internal field test. It&#8217;s much safer then worrying about SOX or revenue recognition by some inferred promise (as much as folks would like to hear it).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Chris Pattinson</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-480</link>
		<author>Chris Pattinson</author>
		<pubDate>Fri, 16 Nov 2007 17:15:01 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-480</guid>
		<description>Hi Richard, 

I agree about voting being problematic, we'll be changing maximum number of votes. For the most part, developers look at QC as a repository for customer bug reports, and then product management looks at it for feature requests. We want to seperate the two purposes as much as possible, though some issues are 'grey' - major rework for performance improvements could be seen as either a feature or a fix ;-)

We are also considering the option of 'I can reproduce this' so that users can check a box, then a value is calculated, clearly showing how many users run into the issue. Personally, I think that is very useful especially to QA. 

You can use the QC Windows client to report an issue, a link can be found here, where you must agree to the disclaimer : 

http://qc.codegear.com/BCDownloadCGI.exe/disclaimer</description>
		<content:encoded><![CDATA[<p>Hi Richard, </p>
<p>I agree about voting being problematic, we&#8217;ll be changing maximum number of votes. For the most part, developers look at QC as a repository for customer bug reports, and then product management looks at it for feature requests. We want to seperate the two purposes as much as possible, though some issues are &#8216;grey&#8217; - major rework for performance improvements could be seen as either a feature or a fix <img src='http://blogs.codegear.com/chrispattinson/wp-includes/images/smilies/icon_wink.gif' alt=';-)' class='wp-smiley' /> </p>
<p>We are also considering the option of &#8216;I can reproduce this&#8217; so that users can check a box, then a value is calculated, clearly showing how many users run into the issue. Personally, I think that is very useful especially to QA. </p>
<p>You can use the QC Windows client to report an issue, a link can be found here, where you must agree to the disclaimer : </p>
<p><a href="http://qc.codegear.com/BCDownloadCGI.exe/disclaimer" rel="nofollow">http://qc.codegear.com/BCDownloadCGI.exe/disclaimer</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Chris Pattinson</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-479</link>
		<author>Chris Pattinson</author>
		<pubDate>Fri, 16 Nov 2007 17:06:03 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-479</guid>
		<description>Hi Joe,

Ok in the future I'll post fix lists referring directly to QC reports. These should sync up on the day of release when the version number of the patch is pushed public. I was learning about that system when QA decided to nose in more with QC, so now am a full admin.

We're looking at the clients in detail too, the team is happy with the client we use internally, and plan to improve the QC one to bring it up to similar level of functionality. The searching in the internal tool is MUCH more powerful, and I agree intuitive colors and information are a must. 

More on the client as things progress. I'm pushing for about a year worth of improvements and work in several steps.</description>
		<content:encoded><![CDATA[<p>Hi Joe,</p>
<p>Ok in the future I&#8217;ll post fix lists referring directly to QC reports. These should sync up on the day of release when the version number of the patch is pushed public. I was learning about that system when QA decided to nose in more with QC, so now am a full admin.</p>
<p>We&#8217;re looking at the clients in detail too, the team is happy with the client we use internally, and plan to improve the QC one to bring it up to similar level of functionality. The searching in the internal tool is MUCH more powerful, and I agree intuitive colors and information are a must. </p>
<p>More on the client as things progress. I&#8217;m pushing for about a year worth of improvements and work in several steps.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Chris Pattinson</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-478</link>
		<author>Chris Pattinson</author>
		<pubDate>Fri, 16 Nov 2007 16:58:08 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-478</guid>
		<description>Thanks Sebastian, the whole revenue recognition and SOX made the communication of intent so much more complex and cumbersome then I ever imagined! We cannot even discuss or communicate what bugs are on our 'to fix' list for upcoming patches - or even if such patches are in the works.

Since voting is so cumbersome, you will all see a change very soon - dramatically increased number of votes, and Sysops will have an increase to the number of votes they can put to an issue. 

We're trying to encourage more Sysops - QC was designed to be a community supported system, and we need plenty of Sysops to make that happen.

As to risk of fix - that's taken into consideration by R&#38;D during development of either major releases or of patches. The Delphi team puts a huge amount of effort into maintaining backwards compatibility. A flag such as 'risky' could be confusing unless used consistently. 

Comments to and from QC - we'll be taking care of that as part of merging QC and RAID, so that engineers work off the same system. I expect that will resolve that particular problem. It's not productive to have to look at two systems to get all the current information.</description>
		<content:encoded><![CDATA[<p>Thanks Sebastian, the whole revenue recognition and SOX made the communication of intent so much more complex and cumbersome then I ever imagined! We cannot even discuss or communicate what bugs are on our &#8216;to fix&#8217; list for upcoming patches - or even if such patches are in the works.</p>
<p>Since voting is so cumbersome, you will all see a change very soon - dramatically increased number of votes, and Sysops will have an increase to the number of votes they can put to an issue. </p>
<p>We&#8217;re trying to encourage more Sysops - QC was designed to be a community supported system, and we need plenty of Sysops to make that happen.</p>
<p>As to risk of fix - that&#8217;s taken into consideration by R&amp;D during development of either major releases or of patches. The Delphi team puts a huge amount of effort into maintaining backwards compatibility. A flag such as &#8216;risky&#8217; could be confusing unless used consistently. </p>
<p>Comments to and from QC - we&#8217;ll be taking care of that as part of merging QC and RAID, so that engineers work off the same system. I expect that will resolve that particular problem. It&#8217;s not productive to have to look at two systems to get all the current information.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: m. Th.</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-472</link>
		<author>m. Th.</author>
		<pubDate>Fri, 16 Nov 2007 09:58:48 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-472</guid>
		<description>6. We are all programmers, remember? :-) You are in this happy position. You (and CG team) don't have to deal with accountants, secretary men, bosses, HR &#38; warehouse crowd and all the economic stuff with which some of us must deal and find a bridge to find their ever-changing requirements and try to understand from their i€ckonomik$ (yuck!) language what they meant. Your symbiotic life with your customers should be much smoother. Leverage this. Give them work to do. Give them QC entries to discuss as Allen does. Mind you, there exists a very well verified human law which says: Lack of work is mother of all evil. Personally, I'm fed up with the interminable threads discussing "How horrible CG are" ™, Win32 vs .NET, LindozeOSX etc. etc. again and again without doing nothing. More that 90% of us are programmers with (much) more than 5 years experience in Delphi (according with Chris's (Bensen) blog). Can we become more effective? Mind you, it's a management problem here... But courage. It's doable. The guard dies but never surrenders.

Sorry for posting (again) a novel.</description>
		<content:encoded><![CDATA[<p>6. We are all programmers, remember? <img src='http://blogs.codegear.com/chrispattinson/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' /> You are in this happy position. You (and CG team) don&#8217;t have to deal with accountants, secretary men, bosses, HR &amp; warehouse crowd and all the economic stuff with which some of us must deal and find a bridge to find their ever-changing requirements and try to understand from their i€ckonomik$ (yuck!) language what they meant. Your symbiotic life with your customers should be much smoother. Leverage this. Give them work to do. Give them QC entries to discuss as Allen does. Mind you, there exists a very well verified human law which says: Lack of work is mother of all evil. Personally, I&#8217;m fed up with the interminable threads discussing "How horrible CG are" ™, Win32 vs .NET, LindozeOSX etc. etc. again and again without doing nothing. More that 90% of us are programmers with (much) more than 5 years experience in Delphi (according with Chris&#8217;s (Bensen) blog). Can we become more effective? Mind you, it&#8217;s a management problem here&#8230; But courage. It&#8217;s doable. The guard dies but never surrenders.</p>
<p>Sorry for posting (again) a novel.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: m. Th.</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-471</link>
		<author>m. Th.</author>
		<pubDate>Fri, 16 Nov 2007 09:48:18 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-471</guid>
		<description>5. The QC is very granular. Look, imho, the data binding in VCL should be updated. This is also the opinion of many community members. So, if I post a QC entry with 'Please update the VCL data binding' do you think that I did something good? You'll promote it? Imho, this must be discussed (a lot) somewhere in an ng and after this posted. See the above points about discussions.</description>
		<content:encoded><![CDATA[<p>5. The QC is very granular. Look, imho, the data binding in VCL should be updated. This is also the opinion of many community members. So, if I post a QC entry with &#8216;Please update the VCL data binding&#8217; do you think that I did something good? You&#8217;ll promote it? Imho, this must be discussed (a lot) somewhere in an ng and after this posted. See the above points about discussions.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: m. Th.</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-470</link>
		<author>m. Th.</author>
		<pubDate>Fri, 16 Nov 2007 09:23:05 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-470</guid>
		<description>4. We don't know what you do. You don't know what we want. Users are very good in feeling their needs. But they are very dangerous in their solutions. Unfortunately, usually they write down their solutions (eg. "I need a thread-safe VCL") rather their needs ("I need to use all the cores of the CPU"). So you must have a dialogue with the users to see which was the initial impulse which generated the report. The sysops try to do this by posting comments but AFAIS from the eMail log which I receive, these are rarely responded. Why? You must find out. Possible reasons (_except_ all the above points): 
- Bad design of QC website - very hard to find how to have (setup) an eMail notification of QC activity. (This is more general, imho. Perhaps sometime I'll post you a 'novel' about how to effectively communicate a message to the others... :-))
- Report is old. The poster lost his hope and doesn't track it anymore. Now it's a Java/VS/Linux developer.
- "Oh, anyway they will fix in two-thee years, _if_ they will fix it. So why bother?" - it's a variant of the above
- "OMG, now I must fight with the sysops. To explain, to try to convince... And all of this for what? No one assures me that someone will try to do my request" - another variant of above. Here something to note: at least in some period (winter of 2006 IIRC) the 'price of innovation' in QC was very high. In order to get a report promoted by sysops it must be at least stellar.
If the folks will 'get' clearly that their effort has an effect on the final product will change the things dramatically, imho. A possible status 'Worked on' would help a lot here. Btw, isn't quite clearly what 'submitted internally' really means... (I'm speaking now from 'it will be handled/not handled properly in a timely manner' POV)</description>
		<content:encoded><![CDATA[<p>4. We don&#8217;t know what you do. You don&#8217;t know what we want. Users are very good in feeling their needs. But they are very dangerous in their solutions. Unfortunately, usually they write down their solutions (eg. "I need a thread-safe VCL") rather their needs ("I need to use all the cores of the CPU"). So you must have a dialogue with the users to see which was the initial impulse which generated the report. The sysops try to do this by posting comments but AFAIS from the eMail log which I receive, these are rarely responded. Why? You must find out. Possible reasons (_except_ all the above points):<br />
- Bad design of QC website - very hard to find how to have (setup) an eMail notification of QC activity. (This is more general, imho. Perhaps sometime I&#8217;ll post you a &#8216;novel&#8217; about how to effectively communicate a message to the others&#8230; :-))<br />
- Report is old. The poster lost his hope and doesn&#8217;t track it anymore. Now it&#8217;s a Java/VS/Linux developer.<br />
- "Oh, anyway they will fix in two-thee years, _if_ they will fix it. So why bother?" - it&#8217;s a variant of the above<br />
- "OMG, now I must fight with the sysops. To explain, to try to convince&#8230; And all of this for what? No one assures me that someone will try to do my request" - another variant of above. Here something to note: at least in some period (winter of 2006 IIRC) the &#8216;price of innovation&#8217; in QC was very high. In order to get a report promoted by sysops it must be at least stellar.<br />
If the folks will &#8216;get&#8217; clearly that their effort has an effect on the final product will change the things dramatically, imho. A possible status &#8216;Worked on&#8217; would help a lot here. Btw, isn&#8217;t quite clearly what &#8217;submitted internally&#8217; really means&#8230; (I&#8217;m speaking now from &#8216;it will be handled/not handled properly in a timely manner&#8217; POV)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: m. Th.</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-469</link>
		<author>m. Th.</author>
		<pubDate>Fri, 16 Nov 2007 09:19:59 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-469</guid>
		<description>3. The QC twins. Can you give a reason why do you have two bug-trackers? Except legacy, perhaps. I'm asking seriously. Because I suspect if a report is 'submitted internally' any update (which means an enhancement, isn't?) to that report isn't taken in account by the internal team. Of course, I don't know if this is a technical problem also or just a workflow one. This is, obviously, besides the classical problems with the parallel systems which you know.</description>
		<content:encoded><![CDATA[<p>3. The QC twins. Can you give a reason why do you have two bug-trackers? Except legacy, perhaps. I&#8217;m asking seriously. Because I suspect if a report is &#8217;submitted internally&#8217; any update (which means an enhancement, isn&#8217;t?) to that report isn&#8217;t taken in account by the internal team. Of course, I don&#8217;t know if this is a technical problem also or just a workflow one. This is, obviously, besides the classical problems with the parallel systems which you know.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: m. Th.</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-468</link>
		<author>m. Th.</author>
		<pubDate>Fri, 16 Nov 2007 08:52:49 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-468</guid>
		<description>2. About formalism.  One of the hottest &#38; most disputed in interminable threads in .non-tech ng was the Delphi's cross-platform issue (IIRC, one of the latest threads on the theme ("Cross-Kylix discontinued") had more than 500 (five hundreds) messages. Can you give me a QC entry for this? Is it in Top 10? Top 50? Top 100? Why? Imho, one of the reasons is that the community lost their confidence in QC as a vehicle to carry their will/wishes to you (but about this I wrote a lot around here, also in the ng), but another reason is that the QC is _formal_ so you have only _one_ wing to fly to your perfect product. Customers always will prefer an informal way of communication (even if they spend more time on this) while a company will prefer the other, for obvious reasons. So, you must provide both of them discussing the ideas in a non-informal way and after this, crystallizing them in a formal one. Personally I use the .non-tech ng ("polluting" it when the others give me the opportunity) and, now, the Allen's blog. Imho, this is the classical solution as other companies have it. In fact (almost) all OSS work in this way. A dedicated ng will fit perfectly for this, imho, but also a blog engine will do (like Allen does now), even if the latter has some drawbacks. Also the QC has the 'Comments' tab but it seems that this tab isn't properly advertised by you and is hard to use (no quoting for ex.), so very little folks use it &#38; know how to monitor the updates. Also, there exists the perception that you (ie. CG employees) doesn’t take part on that discussion, and, hence, 'doesn't really matter what's happening there'. Generally speaking, the way in which is organized QC now doesn't help at all in collaborative refinement of requests.</description>
		<content:encoded><![CDATA[<p>2. About formalism.  One of the hottest &amp; most disputed in interminable threads in .non-tech ng was the Delphi&#8217;s cross-platform issue (IIRC, one of the latest threads on the theme ("Cross-Kylix discontinued") had more than 500 (five hundreds) messages. Can you give me a QC entry for this? Is it in Top 10? Top 50? Top 100? Why? Imho, one of the reasons is that the community lost their confidence in QC as a vehicle to carry their will/wishes to you (but about this I wrote a lot around here, also in the ng), but another reason is that the QC is _formal_ so you have only _one_ wing to fly to your perfect product. Customers always will prefer an informal way of communication (even if they spend more time on this) while a company will prefer the other, for obvious reasons. So, you must provide both of them discussing the ideas in a non-informal way and after this, crystallizing them in a formal one. Personally I use the .non-tech ng ("polluting" it when the others give me the opportunity) and, now, the Allen&#8217;s blog. Imho, this is the classical solution as other companies have it. In fact (almost) all OSS work in this way. A dedicated ng will fit perfectly for this, imho, but also a blog engine will do (like Allen does now), even if the latter has some drawbacks. Also the QC has the &#8216;Comments&#8217; tab but it seems that this tab isn&#8217;t properly advertised by you and is hard to use (no quoting for ex.), so very little folks use it &amp; know how to monitor the updates. Also, there exists the perception that you (ie. CG employees) doesn’t take part on that discussion, and, hence, &#8216;doesn&#8217;t really matter what&#8217;s happening there&#8217;. Generally speaking, the way in which is organized QC now doesn&#8217;t help at all in collaborative refinement of requests.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: m. Th.</title>
		<link>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-467</link>
		<author>m. Th.</author>
		<pubDate>Fri, 16 Nov 2007 08:45:00 +0000</pubDate>
		<guid>http://blogs.codegear.com/chrispattinson/2007/11/13/38893#comment-467</guid>
		<description>Hi Chris, I see that you try to put some effort in QC. Very much appreciated. So, here are some small suggestions (besides the ones which I've posted in .qualitycentral newsgroup). (I will try to broke the themes in more posts, as you wish... :-) )

1. Response time problem. One of the main goals of any IT company (yours, ours) is to minimize the response time. How quick can you fulfill the customer's requests. You must be focused on this. In fact, this is the main reason of existence of QC. No one from your customers (including me) will spend one of their most expensive resources (time) with QC if they doesn't have pretty clear in their minds that their requests will be handled in a timely manner &#38; in an appropriate way. Imho, you (CG) must clarify this first (see my other post in ng).</description>
		<content:encoded><![CDATA[<p>Hi Chris, I see that you try to put some effort in QC. Very much appreciated. So, here are some small suggestions (besides the ones which I&#8217;ve posted in .qualitycentral newsgroup). (I will try to broke the themes in more posts, as you wish&#8230; <img src='http://blogs.codegear.com/chrispattinson/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' /> )</p>
<p>1. Response time problem. One of the main goals of any IT company (yours, ours) is to minimize the response time. How quick can you fulfill the customer&#8217;s requests. You must be focused on this. In fact, this is the main reason of existence of QC. No one from your customers (including me) will spend one of their most expensive resources (time) with QC if they doesn&#8217;t have pretty clear in their minds that their requests will be handled in a timely manner &amp; in an appropriate way. Imho, you (CG) must clarify this first (see my other post in ng).</p>
]]></content:encoded>
	</item>
</channel>
</rss>
