This installment of My First Agile Project is going to be a little different than the previous ones (Table of Contents for the series available at the end of the post). Today I'm going to tackle the topic of tools. During the first year or so of our project we used ScrumWorks by Danube. It was brought to us by our vendor along with the Scrum methodology. After our license ran out we didn't like ScrumWorks enough to get our own license or even go with the free version, which I'll go into more detail about below.
For our last couple of sprints, we've been making due with a whiteboard and evaluating other tools. The one I like the best and we'll probably be going with is VersionOne, which I'll be talking about in more detail next week. Honestly VersionOne makes ScrumWorks look old-fashioned and barely functional. I had a list of things I didn't like about ScrumWorks and one of the first things I noticed during my initial demo was that VersionOne didn't do any of those things, obviously a big selling point. This week's post is that list of pros and cons about ScrumWorks.
Choosing a tool can be very important in a lot of software development and choosing where to put your backlog and tasks is extra important to Scrum. Since the whiteboard/corkboard + stickies/index card approach is basically free, you want to choose a tool that gives you some extra benefit. Read on for my team's pros and cons about ScrumWorks and hopefully it'll provide some insight on this important decision.
What we liked about ScrumWorks
The first thing I should say is that we started using ScrumWorks over a year and a half ago and I only recall doing one update so my experience might be out-of-date. I didn't bother looking at ScrumWorks again when looking for a new Scrum tool. Also, these are my and my team's opinions only and I'm not affiliated with either Danube or VersionOne beyond using them.
1) Gave Us Structure
As I said, our vendor brought ScrumWorks with them along with the Scrum methodology when they came to work with us on our project. Since this was our first exposure to Scrum, bringing a tool they were familiar with was a good idea. If we hadn't had the guidance on the process that ScrumWorks brought just by having a set workflow and screens that asked for the important information for backlog items and tasks, it would have been a lot more work getting going. If we'd had to figure out what needed to go on cards, which cards went where, how to make a burndown chart, etc., it would have taken a lot of time.
2) Did the Basics
We also liked being able to see our tasks and make changes online, run reports, make graphs, etc. Being essentially lazy, having a program automatically make the burndown chart alone is worth a lot to me.
An aside about Burndown charts
One unrelated note on these automatically generated burndown charts: make sure your upper management doesn't fall too in love with them. We had problems early on with our management not understanding the process and using whether or not the line on the chart was going up or down as their only view into how the project was going. Managers love graphs and will (ab)use them if you let them. You learn things and change estimates and the line goes up. This is fine.
What we didn't like about ScrumWorks
This is the bigger of the 2 lists, unfortunately. ScrumWorks gave us the basic functionality required for a backlog/task manager. How it did that is where the annoyances came from. Now, these things might not annoy you and I'm sure they made some of these choices on purpose but they didn't suit our team. Tools are very individual and I think ScrumWorks is pretty popular so other people must love the heck out of it. That was not our experience.
3) Too Many Required Fields
The first annoyance we ran into was that ScrumWorks makes too many things required. To enter a backlog item you have to do your difficulty estimate, and enter a value for business benefit before you can save the item. This gets in the way of just entering things into the product backlog so you don't forget about it later. Estimating difficulty should be the team's job (or at least the team member responsible for the item), not the job of whoever enters the item. And being forced to enter a benefit in just so ScrumWorks can do its priority calculation (it gives you a ratio of difficulty to benefit) was extra annoying because we never used the calculation it gave. Since our project was to replace an existing system, everything we entered at first was functionality we had to replace so how were we to determine the benefit? We tried at first but it just wasted time in planning meetings. At the end we were just entering 5 for everything it required us to fill in just to get past the screen.
4) Too Much Required Workflow
In the same vein, you also have to estimate tasks as they're created and you're not allowed to assign a task to somebody before you put the item into a sprint. It's one thing to suggest people follow the proper procedure, it's another when your tool forces you to do things a different way than you want to for no reason. I can't tell you how many times we were forced to stop our planning flow to do things the way ScrumWorks wanted us to.
5) Can't Split Items Between Sprints
Another big irritation was the inability to split up items between Sprints. If you don't finish a task during a sprint, you're forced to move the whole backlog item to another sprint, losing the history of when you first did what. The first chunk of our planning meetings was spent going through unfinished items, checking if they were actually incomplete or if we just forgot to close them out, and moving the item to the current sprint. I was beyond pleased to find that VersionOne gives you an easy way to split things up between sprints.
6) Forces You To Use 2 Different Tools
ScrumWorks is actually 2 tools, a web-based taskboard and a regular desktop application for sprint and backlog maintenance. I can only guess that either they, unlike VersionOne, didn't think the web could handle the maintenance interface or they added the taskboard web interface later. In either case, it's jarring to have to go from the taskboard to a different URL to launch the desktop app for certain things. But the web interface is the one you use most of the time so that's not a huge concern.
7) Can't See Only Your Tasks
First is that you can't just see your own tasks and items. All the items are shown in a long list and you just have to scroll or search for yours. They're highlighted with a color but you can't just show yours. This led to a lot of problems with people not knowing they had been assigned something or forgetting to update a task because they skipped over it. Just because you can't sort or filter a whiteboard with index cards doesn't mean I shouldn't be able to filter a web list of tasks. That's a head scratcher of a decision to me, it makes no sense.
8) Web Interface Became Unusably Slow
The more sprints we went through, the slower the web interface became. I won't guess at how they designed the thing to say why that might happen but it was almost unusably slow after 9 or 10 sprints.
9) No Way To Find Each Team Members' Hours
There's no way to find how many hours of work you have assigned to you. It's not in the web interface and if it's in the desktop app we never found it. What we always had to do was export the sprint to Excel and use the Filter feature to show each person's tasks, then add up the hours. Obviously not ideal.
Conclusion
I hope that gives you a feel for what we liked and didn't like in ScrumWorks. It does what its supposed to, giving you control over items and tasks and whatnot, but the way it does those things ranges from no-frills to annoying to infuriating. It was never really a question on our team if we wanted to continue using it or not, we even considered just writing our own basic version. As I said, our experience is a year old now and they might have revolutionized the product for all I know. But for now, we're all glad to be off ScrumWorks, even if it means being without a good tool for the time being.
I meant this entry to be a review of both ScrumWorks and VersionOne but in the interest of not putting any more of my readers to sleep than I already have, I split this up and will give each tool the space they deserve. If you're dying for a VersionOne review before next week, I give it a big thumbs up and encourage you to talk to them about doing a demo. They let you use it for 30 days and I found that a big help. They also have a ton of videos and tutorials that give you a feel for using the tool. More on our experience next week! Thanks for reading.
If you have experiences with ScrumWorks you'd like to share, please do in the comments below.
My First Agile Project Series
Part 1: Doing 80%
Part 2: Inception & Planning
Part 3: Viral Videos and Bad Jokes in Scrum Demos
Part 4: How to lose credibility and jeopardize your project with lack of management buy-in
Part 5: Our Top 5 Agile Mistakes
Part 6: The First End of Our Project
Part 7: Adventures in Agile Testing
Comments
VersionOne is nice!
October 20, 2008 by Kevin E. Schlabach (not verified), 1 year 15 weeks ago
Comment id: 1918
I agree with you. As I was evaluating tools for my company, I also chose VersionOne. My main reason was flexibility and configurability. My company is shifting towards agile, but is slowly working its way there. I can't afford to have a tool enforce strict agile rules, and I need one that can encourage the rules as we mature into them.
VersionOne allowed me to do this, and we've been happily using it for 9 months now.
Scrumworks rocks
October 20, 2008 by Anonymous (not verified), 1 year 15 weeks ago
Comment id: 1919
Totally disagree with you and Kevin. We use scrumworks for 6 teams across 4 locations. It scales nicely, not slow downs.
Kevin in the end you will have a bad process because V1 is built without the proper guide rails to get your team to do scrum
V1's problem is that it fails because it's trying to be everything to everybody, when tryin to pitch the management team on scrum, you want a scrum tool. I would encourage you to utilize the new release of Scrumworks, otherwise you are comparing apples to oranges.
another scrum tool
October 20, 2008 by beefarino (not verified), 1 year 15 weeks ago
Comment id: 1920
Have you looked at Tackle (http://www.codeplex.com/Tackle)? We used that for a bit before the developers decided they couldn't be bothered to update a backlog on their own. Fracking primadonnas.
Pros: free; open source; single web interface for all activity; user-level authn/authzn; burn-down charts; product backlog management; resource management, automagic sprint backog creation from product backlog; task splitting (on both sprint and product backlogs);
Cons: requires IIS, some features (like charts) available only in IE (or in FF with the IE tab extension).
Good feedback, we've had the opposite reaction
October 20, 2008 by Brock Gunter-Smith (not verified), 1 year 15 weeks ago
Comment id: 1921
Great overview of your reaction to ScrumWorks. One thing for other readers to remember is that ScurmWorks Pro is not a task/bug tracking system, it also very strictly re-enforces Scrum principles, processes and rituals. In our experience and with our projects it has worked exceptionally well...but perhaps because we were looking for a Scrum tool, not a general purpose agile-oriented software planning application.
With a team of 7 developers and about 40 sprints under our belt across multiple projects we saw no slows downs and in fact saw pretty big improvements in the software with each progressive upgrade.
The BV (Business Value) data is not required and does not need to be entered into backlog items contrary to what the article indicates. Our PO and other stakeholders enter stories into the backlog. The PO selectively enters BV data when it's relevant, but for 9 out of 10 stories we don't use it.
I agree that it would be nice to task stories while they are in the backlog in some cases, but what we've done is that if we KNOW that a story will be in the next sprint and we want to expend energy on tasking it out, we create the next sprint or two ahead of time, drag in the stories we want to task away. We've only done this a couple times as really, until near the end of the sprint we don't know what will be in the next sprint and don't want to waste time tasking something that hasn't been accepted and committed to by the team with the PO.
I've been looking at a lot of other tools, but for our team we couldn't find any other project that worked as efficiently as ScrumWorks Pro to help the team manage our stories and sprints, and rely on Redmine to manage our bugs outside of that process.
Reviewing an 18 month old release?
October 20, 2008 by Anonymous (not verified), 1 year 15 weeks ago
Comment id: 1922
Looks like you're comparing V1 to ScrumWorks release 2.x, released some 18 months ago. ScrumWorks 3 is a whole new ball game in terms of the interface and UI functions. Nearly none of the things you mention are drawbacks in ScrumWorks 3. We're using it now and did our comparison to V1 a while back and we selected Scrumworks hands down. We use it with hundreds of users in multiple locations, so whatever scaling issues you observed are likely a fluke or somehow tied to your environment.
Some errors in your review of ScrumWorks:
- Required fields: none of the fields you mention are actually *not* required at all. Story estimates and business value can be left blank...
- There is a whole "My Tasks" view of the Web Client. That's new as of ScrumWorks 3, I'm guessing.
- You can easily see any team members' tasks by highlighting that team member in the web client, filtering by the team member in the desktop client. Again, you're revieiwing an old release.
- You can split stories/items in ScrumWorks 3.
The other thing we love about Scrumworks is the Enhanced burndown chart. It tells us if our release is on track or not. THere was nothing like that in V1 or any of the other tools. We love Scrumworks web reports too, that's a life saver.
In general, our issue with V1 was the lack of demonstrated understanding of the Scrum process, and frankly Agile, in general. It confuses too many principles that are core to Agile and then presents alternatives based on waterfallish thinking. I think V1 leads to the dark side... :) Scrumworks was built by people that know Agile through and through. But that's just my personal opinion based on my understanding of Agile principles.
Totally agree with your
October 20, 2008 by Anonymous (not verified), 1 year 15 weeks ago
Comment id: 1923
Totally agree with your review of ScrumWorks - we did the same analysis on several agile tools internally earlier this year. In addition to having templates for specific methodologies such as Scrum and XP, the VersionOne product allowed us to easily customize it to better match our own Scrum process better than any tool other we evaluated. All of our internal users found it ten times easier to use. I guess the saying goes - "to each his own".
templates in V1 are just wrong
October 20, 2008 by Gregg S (not verified), 1 year 15 weeks ago
Comment id: 1925
the templates in V1 are wrong, so it leaves you really messed up in terms of process. My advise is to get a certified scrum trainer to teach you the basics first. We had Tobias Mayer, he's great.
Go to the Scrum Alliance homepage find trainer and get trained then figure out which product is best. If you are doing Scrum, my guess is that scrum works is best. if you aren't then then my guess is that V1 is best.
ps: we ended up with scrum works
Gregg S
ScrumDesk
October 20, 2008 by Dusan Kocurek (not verified), 1 year 15 weeks ago
Comment id: 1926
Try ScrumDesk (http://www.scrumdesk.com), please.
It is a Windows application with features you are missing:
- split of stories
- My tasks or filter by user
- only few attributes are required
- burn down and burn up chart (easy recognition of added stories or tasks )
Hi Matt, My name is Victor
October 21, 2008 by Victor Szalvay (not verified), 1 year 15 weeks ago
Comment id: 1927
Hi Matt,
My name is Victor Szalvay and I'm the ScrumWorks Product Owner. I appreciate you writing a review, and as many before me have pointed out, I only wish you had the opportunity to review the most recent release of ScrumWorks Pro. It certainly addresses many of the objections you raised and introduces a ton of enhancements focused on large organizations implementing Scrum.
For instance the required fields issue, "my task" views, tasks filtered by users, etc., are all part of ScrumWorks 3. Also, you're conflating priority with ROI, the priority of items in ScrumWorks is determined by drag-and-drop position, so business valuation is not required for priority (never was). Splitting undone items over more than one sprint is a bad idea due to the "no partial credit" philosophy espoused by most Agile luminaries.
In general, ScrumWorks is for doing Scrum, in particular at large organizations. Our support for directory authentication, web reports, business value metrics, and complex backlogs shows our dedication to the enterprise. We're not trying to build a generalized framework tool for "agile-ish" processes. We're building features and leaving others out very deliberately as our trainers and consultants report field successes and failures.
As evidenced by the responses to this thread, ScrumWorks is popular because it's faithful to the Scrum process. We'll continue on this path into the future as we address the changing needs of enterprises implementing Scrum.
Buyer Beware
October 21, 2008 by Anonymous (not verified), 1 year 15 weeks ago
Comment id: 1930
Looks like the whole scrumworks product team may have responded given the specific features and versions referenced. I would suggest evaluating for yourself based on your own requirements vs. a vendor's. We evaluated both and there was really nothing we found more Scrum about Scrum Works than VersionOne other than the name. Version One worked best for our Scrum process, but that is not to say you will have the same experience.
I would echo first the need for good coaching.
What about Rally?
October 21, 2008 by Anonymous (not verified), 1 year 15 weeks ago
Comment id: 1931
I'm surprised Rally wasn't mentioned as part of this evaluation.
What about TargetProcess?
October 21, 2008 by Michael Dubakov (not verified), 1 year 15 weeks ago
Comment id: 1932
I'm surprised TargetProcess wasn't mentioned as part of this evaluation. TargetProcess has comparable functionality and easy to use UI. All of the problems mentioned above are not exist in TargetProcess.
http://www.targetprocess.com
Should review
October 21, 2008 by Artem, 1 year 15 weeks ago
Comment id: 1934
Thorough review of modern tools is in our plans. Well, maybe we should eventually bite the bullet, find time and do a good and careful (video?) review of them.
find your own review targetprocess
October 22, 2008 by Anonymous (not verified), 1 year 15 weeks ago
Comment id: 1935
Why has Michael Dubakov from target process commented on every single review of every other agile tool that appears on the web?
I have Google Alerts :)
October 22, 2008 by Michael Dubakov (not verified), 1 year 15 weeks ago
Comment id: 1937
[offtopic] I don't say anything bad about other agile tools. I do respect all the tools on the market and all the companies behind. Just trying to make TargetProcess more visible to people. The choice should exist, isn't it?
Scrum Tool
October 31, 2008 by Anonymous (not verified), 1 year 14 weeks ago
Comment id: 1964
I suggest you try Caimito One Team or visit the wiki from Caimito One Team (http://wiki.caimito.net/display/AGILE/Home). Caimito One team is a helpful tool for Agile Development based on Scrum.
Tried All Three Products
November 6, 2008 by Derick Dawson (not verified), 1 year 13 weeks ago
Comment id: 1979
Our Team has tried and extensively studied all 3 of the main products - VersionOne, ScrumWorks, and Ralley. Although all have some good things and some bad things, we are definitely going with VersionOne. Yes it does have more flexibility and this was a major help for us to stream-line our agile projects and work into it coming out of waterfall. We made sure our scrum masters were getting their teams to use best practices and in the end if things are done right the flexibility of VersionOne actually helped us funnel into doing Agile properly and our team was much more willing to accept it and now we are pumping out 2 week iterations and not missing deadlines and doing true agile programming with 4 of our teams. I would suggest looking at all but we did and our Vote was VersionOne. Their Customer service is the best I have ever seen, if I ever have a question I have tons of resources and they are always available and happy to help. Two Thumbs Up!
Derick
webreport
July 1, 2009 by Anonymous (not verified), 31 weeks 5 days ago
Comment id: 2795
The problem with the web reports in scrumworks is that always the latest ones are visible even if we had saved the previous ones, it always overwrites with the latest data. So all the links that you had saved point to the same latest report. Has any one experienced it and what is the solution. This is very annoying and useless feature.
Post new comment