I received an email recently asking if I'd review AxoSoft's OnTime 2005 Team-Based Defect, Feature and Task Tracking software
in exchange for a small fee. I'm usually happy to review software and tools when time permits, I'll always do it in an unbiased way to the best of my ability , and the small stipend (or free gadgets) is a nice recognition of the value of my time. This review is by me personally, and has nothing to do with my company who does not use or advocate the user of this tool.
Updated: I haven't been paid for this review and won't be. However, I did receive a free copy of the software.
AxoSoft's "OnTime 2005" - Team-Based Defect, Feature and Task Tracking Software
AxoSoft's OnTime 2005 is .NET-based application suite for managing many aspects of the software development lifecycle. It aims to be a complete system for Software Project Management and provides not only a Web-based solution, but also a complete WinForms solution as well as one that integrates with VS.NET as a toolbox.
They also have an "Enterprise Server" edition that lets remote users connect via Web Service rather than directly to back-end SQL. You can use SQL Server or MSDE for your backend. I used a private MSDE installation with no problems. You of course are bound by MSDE's size and concurrency limitations if you take that road, but a team of 5 could certainly do well with MSDE, IMHO.
There is an SDK in the form of a rich Web Services interface into the OnTime system for integrating into other lifecycle management systems that you may already have in place. This is pretty powerful stuff and it's a shame more applications don't take the effort to expose their core engine as Web Services. (example screencast) I can imagine building defect submission directly into a Help|About box or a global exception handler. Patrick Cauldwell mentioned today that he heard at Devscovery yesterday a koan that really resonated with him: "If you have get an unhandled exception, you've never executed that code in that way before." Integrating the defect tracking system with the application itself is cool thing. AxoSoft also offers a Customer-facing Portal that can enable users to report bugs themselves.
Finally, if you're not into managing the infrastructure or SQL/Windows licenses yourself, there's a hosted plan. However, my take is this. They offer a FREE single user version. Not a trial. Free. That'd be a great way to start out with lifecycle management tools for the independent developer and gives AxoSoft a way to compete with the free BugZilla tools. Also, for a limited time they've got a free 2-user license if you mention their software (so they get Google Juice). Not sure how long that will last, but free software is always a good thing.
I installed a private instance of MSDE that I called (local)/OnTime before starting. Then I installed the WinForms, Web and VS.NET versions of OnTime. They came in three MSIs, and we're trivial installs (next, next, next, finish). On running each application I was prompted to connect the database. I was a little confused since I used MSDE and had forgotten the (local)/instance style of connection string. It would have been nice had that tip (or a step-by-step MSDE vs. SQL quick start) been in the OnTime help file. They suggest in the Planning Section to use MSDE Instances, but then Instances aren't mentioned later in the help. Also, I installed my MSDE instance as "Windows Integrated Auth" only, and I should have used Mixed Mode, allowing both Windows users and SQL users to connect. This caused trouble when I tried to run the Web version of OnTime. Once I switched over to Mixed Mode it was cool. It would be nice if OnTime helped diagnose that likely common problem in a friendlier way. However, these are nits, and the install in total was all of 10 minutes.
I was pretty pleased to see on the database configuration dialog a "Populate New Database with Sample Data" checkbox. I love stuff like that. Simple and does the job. Of course, checked. The sample data is pretty extensive and include three fictional projects and their numerous associated sub-projects. It's fairly classic three-pane style with tabs. (screenshot above). The datagrids include excellent filtering, grouping, sorting, yada yada support. They also handled my crazy font changes. I always mess with the defaults to see if an app can handle it. Plus, it makes it easier to see. No problems there.
The WinForms has a nice, speedy UI with splitter support in all the appropriate panes. The dialogs are logical and well laid out and I didn't need to read any documentation to get started immediately. I was able to add a custom field to my bugs (I added "locale") and associate a pick-list with choices (en-us, es-mx, etc) without trouble. There are Defects, Features and Tasks and all support an unlimited number of custom fields.
Some of the dialogs were not resizable and should have been, with the User Options dialog being the most obvious omission. There were a few subtle dialog updating bugs I found like the Windows Common Font Dialog isn't populated with the current font when you press "..." in the User Options dialog. I suspect it'll be fixed when they read this review. :) However, I didn't have any crashing bugs and didn't come upon any major functional bugs in my week with the application.
There is a QuickAdd feature in the WebForms version that would be a nice addition to the WinForms version. The dialogs in the WinForms version, particularly for editing an item are modal, and AxoSoft could really increase usability by making them modeless and allowing multiple simultaneous views/edits.
There are 17 built-in reports that will meet 85-90% of your needs I suspect and 100% of Mort's needs. The lack of an editable report maker was the only real missing chunk of desirable functionality that I found, but I suspect I could use any reporting tool to make my own pretty easily. I do wish though, that the charting colors were at least configurable for red-green colorblindness. In the WebForms application the reports are automatically exported as PDFs, and in the WinForms application they are exportable PDFs in an embedded control within the application.
The configurable workflow capabilities really shone, I thought. The default five defect steps are typical, but you can add your own, as well as modify many of the items fields as they move through the process. You're not able to provide arbitrary script or modify your custom fields from the workflow that I could see. The features don't come with automatically configured workflows, but they can be added exactly as with defects. The workflow dialogs are simple, but provide logical defaults for what a small team would need to manage a defect's lifecycle.
Email notification also plays a big part in OnTime, and the you or anyone in the team can be notified as items move through the process. I also noted that I didn't have to explicitly opt-in to including my custom "locale" field into the emails. It was added automatically. You can imagine that this saved me the time of digging wondering why it wasn't included.
An Audit Trail is also included for all events and can be filtered by any aspect including the source of the event - was the item changed manually, as a result of a workflow, via data import or by a customer on the portal?
Exporting of data is only supported in CSV, and it would be nice if they'd include an XML feature, but the XML Web Services interface from the OnTime SDK can arguably serve one's purposes as well.
I liked the flexibility of Security Roles for giving certain classes of users add, manage, delete, etc capabilities to projects. However, it appears you can't change the "verbs" on a project by project based. Meaning that if Tester Fred can add defects on project A, then he can add them anywhere. They do get around this in a reasonable way by combining roles and projects into project-specific roles ("Tester - Project A"). Since a user can be a member of any number of groups this technique works fine. I think though the that the presentation of this information, while complex, could have been more explicitly expressed.
The VS.NET view is a composite that appears as a toolbar within VS.NET and for me, it looks a bit like Team System except it's running on Visual Studio 2003. The grid in VS.NET includes tasks, features and defects all in the same grid. After using it for a while exclusively within VS.NET, I found myself wishing that this composite view was available in the WinForm and/or WebForms application.
All in all, OnTime 2005 Small Team Edition offers a great deal of value for the $ in my opinion. The single user version is free, and $495 for 5 users or $995 for 10 seems very reasonable for any small development shop using the Small Team Edition. The pricing for the Standard Edition (for > 10 users) is much less compelling per-seat at nearly double the price for license that let users use any version (Win/Web/VS.NET) of the product. The Small Team Edition is definitely worth a good look.
P.S. They are also looking at Source Control Integration directly into OnTime, which sounds pretty sweet.