49 contemporary user agents which stress-test adaptive detection in DetectRight, WURFL and DeviceAtlas

Transcription

1 49 contemporary user agents which stress-test adaptive detection in DetectRight, WURFL and DeviceAtlas By Chris Abbott DetectRight Limited 1 st June 2010

2 Abstract 49 recent user agents were extracted from a contemporary user traffic stream and submitted to three device detection engines: DetectRight (DR) ( WURFL ( DeviceAtlas (DA) ( Composite scores showed: DeviceAtlas: 37% WURFL: 46% DetectRight: 96%. Detection performance scores were: DeviceAtlas: 27% WURFL: 44% DetectRight 100%. Performance on key datapoints was highly affected by recognition failures. Report compiled 1 st June 2010

3 Devices and composite scores in this document Page Section Device DR WURFL DA 8 Android HTC Buzz 5/5 1/5 2/5 9 Android HTC Desire 5/5 4/5 0/5 10 Android T-Mobile G1 5/5 3/5 3/5 11 Android Google Nexus One 5/5 4.5/5 0/5 12 Android Huawei U8230 5/5 5/5 3/5 14 WinMo Orange SPV M600 5/5 0/5 0/5 15 WinMo Generic Opera WinMo 3/5 1/5 0/5 16 WinMo HTC T7385 Touch Pro2 5/5 1/5 1/5 17 WinMo HTC P4500 TyTN 4.5/5 3/5 2/5 18 WinMo Samsung GT-i8000 Omnia 2 4/5 0/5 4/5 20 BlackBerry BlackBerry /5 4/5 5/5 21 BlackBerry BlackBerry 8520 Curve 5/5 4/5 5/5 22 BlackBerry BlackBerry /5 4/5 5/5 23 BlackBerry BlackBerry /5 0/5 3/5 25 Apple Apple iphone 5/5 4/5 5/5 26 Apple Apple ipod Touch 5/5 5/5 4/5 28 Samsung Samsung GT-i7000 Galaxy 5/5 5/5 0/5 29 Samsung Samsung GT-B7610 5/5 1/5 0/5 30 Samsung Samsung GT-B5310 5/5 4/5 3/5 31 Samsung Samsung SGH-D407 5/5 4/5 2/5 33 Sony Ericsson Sony Ericsson Z520i 5/5 0/5 0/5 34 Sony Ericsson Sony Ericsson K790i 4/5 3/5 3.5/5 35 Sony Ericsson Sony Ericsson W810i 4/5 3/5 3/5 36 Sony Ericsson Sony Ericsson K800i 4.5/5 3/5 4.5/5 Page Section Device DR WURFL DA 38 Sony Ericsson K550i 5/5 2.5/5 0/5 40 Vodafone Samsung GT-B2100 5/5 4/5 5/5 41 Vodafone Vodafone V1240 4/5 4/5 0/5 42 Vodafone LG HB620T 5/5 2/5 4/5 43 Vodafone Vodafone 725 5/5 5/5 2/5 44 Vodafone Vodafone 810 5/5 0/5 0/5 46 Verizon ADR6200 (Eris) 5/5 3/5 2/5 47 Verizon ADR6300(Incredible) 5/5 4/5 1/5 48 Verizon UT Starcom XV6800 5/5 1/5 0/5 50 Sprint Touch Pro 2 (T7380) 5/5 1/5 1/5 51 Sprint PPC6900 5/5 1/5 3/5 52 Sprint PPC6800 5/5 1/5 5/5 53 Sprint PPC6850SP 5/5 1/5 0/5 54 Sprint MP6950SP/BM 5/5 0/5 0/5 56 O2 XDA Atom 5/5 0/5 2/5 57 O2 XDA Flint 5/ /5 58 O2 XDA Exec 5/5 2/5 1/5 59 O2 XDA II Mini 5/5 1/5 0/5 61 KDDI/AU Toshiba PLY 5/5 1.5/5 0/5 62 KDDI/AU Kyocera W65K 5/5 3.5/5 0/5 64 Nokia Nokia E72 4/5 1/5 3.5/5 65 Nokia 5320 XpressMusic 5/5 1/5 2/5 66 Nokia N95 5/5 1/5 0/5 67 Nokia N8-00 5/5 1/5 3.5/5 37 Sony Ericsson Xi1 5/5 0/5 0/5

4 Introduction Comparing device detection engines for accuracy has rarely been done, due to the difficulty of judging the results, and the difficulty of getting test data from outside the system. In addition, device databases tend to be interdependent, thus creating a self-referential incorrect consensus on the scale of the device detection problem space. WURFL and DeviceAtlas were chosen for this test because they are the most commonly used detection engines, and form the basis of numerous commercial and non-commercial services for large and small companies. I used a proprietary tool Detector Inspector to pick some real useragents from genuine contemporary web traffic to a rich media site. The user agent was usually newer than the data in the detection engine and thus a test of its performance on chaotic and new real-world data. Marks are given for each detection, with the mark starting from 5 and having one mark subtracted for each mistake. Generic detections with no redeeming features get zero. Where the marking differs from this, an explanatory comment is generally added. Comments are intended to consider why a particular engine failed or succeeded, and to illustrate particular points about the benefits and shortcomings of particular detection strategies. Comments are personal to Chris Abbott, and do not necessarily reflect the beliefs or opinions of DetectRight Limited DetectRight is a trademark of DetectRight Limited. DeviceAtlas is a trademark of mtld Top Level Domain Limited.

5 Component Scores Section Maximum DetectRight WURFL DeviceAtlas Detection Accuracy % 44% 27% Screen size % 43% 39% MIDP Version % 44%** 51% MP % 59% 61% 3GPP Video % 51% 35% Browser Detection 48 98% 38% 0%* OS Version Detection 37 92% 38% 17% The figure is a 1/0 count of failures/successes in that area, expressed as a percentage. * DeviceAtlas does not give browser ID information ** WURFL does not have a field for MIDP 2.1 which impacts this score

6 Section Number of detections Composite Scores DetectRight WURFL DeviceAtlas Android 5 100% 70% 32% Windows Mobile 5 84% 20% 24% RIM BlackBerry 4 95% 60% 90% Apple iphone OS 2 100% 90% 90% Samsung 4 100% 70% 25% Sony Ericsson 6 92% 38% 37% Vodafone 5 96% 60% 37% Verizon 3 100% 53% 20% Sprint 5 100% 16% 36% O % 32.5% 15% KDDI/AU 2 100% 50% 0% Nokia 5 95% 20% 45% All detections 49 96% 46% 37% Note: numeric score is based on recognition/detection performance and the accuracy of key datapoints. It s possible for a systemto fail the detection and score points, and for a system to recognise the device perfectly but still lose points on other items of data (for instance, the wrong OS version number, or not recognising that the device supports video). Since the useragents tested were all seen in the wild, it s reasonable to expect a device detection system to cope with them. DeviceAtlas does not attempt to give browser or version information, but has not been excessively marked down for that, though this data is importantin real life. WURFL data used was wurfl.xml dated 24/5/10, with PHP API 1.1 downloaded 17/5/2010. DeviceAtlas file was a licenced file dated 14/5/2010 with data from 08/05/10.

7 Android Devices Android device useragents are quite challenging for a detection engine. Android devices are proliferating, and devices are frequently upgraded. This means large numbers of unique or novel user agents hitting engines. Detecting OS version is pretty important for capabilities You can generate more Android detection tables like this at

8 HTC Buzz (Android 2.1) Mozilla/5.0 (Linux; U; Android 2.1-update1; en-us; HTC Buzz Build/ERE27) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile Safari/ A very new HTC Device with same initial as another HTC Platform (Bravo). Which engine will generate a buzz? Detected As: HTC Buzz HTC Desire HTC Bravo DeviceAtlas over-identified again., WURFL picked the wrong similar string A8546ca761e5acd910d8c301ab htc_desire_ver Mozilla/5.0 (Linux; U; Android 2.1- update1; en-us; HTC Buzz Build/ERE27) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 2.1-update1; xx-xx; HTC Desire Build/ERE27) AppleWebKit/ (KHTML, like Gecko) Version/3.0.4 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 2.1-update1; en-us; HTC B DA went up to HTC B before deciding on Bravo. The HTC Butterfly (if there was such a thing) would also generate this match. Screensize: 240x x x800 WURFL gets it wrong through detecting the wrong device. DA also makes the screen much bigger than it should be. MIDP version: 2.1 No 2 In this case DA misses a J2ME upgrade to 2.1 caused by Buzz being a newer device. WURFL doesn t give this a JVM. MP3 Support: Yes Yes Yes 3GPP Support: Yes Yes Yes Detected Browser: Mobile Safari Android Webkit Not Available Detected OS: Android 2.1 Android 2.1 Android OS version missing for DA Performance Mark: 5/5 1/5 2/5 Not all HTC B-names are Bravo.

9 HTC Desire (Android 2.1 udpate 1) Mozilla/5.0 (Linux; U; Android 2.1-update1; en-de; HTC Desire Build/ERE27) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile Safari/530.1 HTC Desire is not a model as such, it s a hardware platform upon which other models are built. How will that work? Detected As: HTC Desire (Hardware Platform) HTC Desire Unknown Vendor Unknown Model 89c37301bd68f1d1c4645ce03bcf5152 htc_desire_ver1 DR and WURFL get this. DetectRight tries to differentiate between Hardware Platforms (reference designs upon which other organisations build) and Devices (things which are sold to the public). Mozilla/5.0 (Linux; U; Android 2.1- update1; en-de; HTC Desire Build/ERE27) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 2.1-update1; xx-xx; HTC Desire Build/ERE27) AppleWebKit/ (KHTML, like Gecko) Version/3.0.4 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 2.1-update1; en- DA gave up after the language! Screensize: 480x x800 Not Available DA doesn t get this information. HTC Desire is a very good phone, so this is a bad miss. MIDP version: 2.0 No No You can sell apps to this device if you know it supports MIDP, but WURFL and DA don t pick this up. MP3 Support: Yes Yes No DR and WURFL get this right 3GPP Support: Yes Yes No Android supports 3GPP on all versions, if only to H.263. Detected Browser: Mobile Safari Android Webkit Not Available It s debateable whether Android Webkit is a browser, since Mobile Safari is a brand, but WURFL is consistent. Detected OS: Android 2.1 Android 2.1 Not Available DR and WURFL share the spoils Performance Mark: 5/5 4/5 0/5 DA s detection is no object of desire.

10 T-Mobile G1 (Android 1.6) Mozilla/5.0 (Linux; U; Android 1.6; --; T-Mobile G1 Build/DMD64) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ What difference do dashes make? Detected As: T-Mobile G1 Android Dev Phone 1 T-Mobile G1 DeviceAtlas and DR got this right. WURFL chose the Android Dev Phone. Wrong, but relevant. ac8457fd37b7bb7336f25e5fd4aa3e59 android_dev_ver1_subandroid 16 Mozilla/5.0 (Linux; U; Android 1.6; --; T- Mobile G1 Build/DMD64) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 1.6; xx-xx; Android Dev Phone 1 Build/DRC83) AppleWebKit/ (KHTML, like Gecko) Version/3.0.4 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 1.6; - DeviceAtlas got this right: but for the wrong reason. Any Android string with OS 1.6 and a dash will be recognised as a T-Mobile G1. Given the flexibility and variety of Android strings, this is not a wise heuristic. Screensize: 320x x x480 Everyone gets this right: Android Dev Phone 1 was pretty close to G1 in specs. MIDP version: No No No UAProfiles do not mention MIDP support MP3 Support: Yes Yes Yes 3GPP Support: Yes Yes Yes Detected Browser: Mobile Safari Android Webkit Not Available Detected OS: Android 1.6 Android 1.6 Android 1.0 A surprise here is DA s Android version number of 1.0, when the identifying string is version 1.6. Performance Mark: 5/5 3/5 3/5 DeviceAtlas s matching algorithm gets lucky, as does WURFL s.

11 Google Nexus 1 (Android 2.1 update 1) Mozilla/5.0 (Linux; U; Android 2.1-update1; sv-se; Nexus One Build/ERE36B) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile Safari/ An updated Nexus One. How will the update affect the detection? Detected As: Google Nexus One Google Nexus One Unknown Vendor Unknown Model 257b78e130c69568e70e8ef3016b8031 google_nexusone_ver1_sub1 A complete miss for DA, an hit for WURFL. Mozilla/5.0 (Linux; U; Android 2.1-update1; sv-se; Nexus One Build/ERE36B) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 0.5; en-us) AppleWebKit/522+ (KHTML, like Gecko) Safari/419.3 Mozilla/5.0 (Linux; U; Android 2.1-update1; This is puzzling. DA at least knew by this point that it had an Android 2.1 device, but there s no OS level fallback data. Screensize: 480x x480 Not Available Failure for DA. Not sure about that WURFL aspect ratio MIDP version: No No No MP3 Support: Yes Yes No Bad mistake here for DA, thanks to the detection miss. 3GPP Support: Yes Yes No Another bad miss for DA Detected Browser: Mobile Safari Android Webkit Not Available Detected OS: Android 2.1 Android 2.1 Not Available DA s missed detection exacts a price Performance Mark: 5/5 4.5/5 (aspect ratio is odd) 0/5 Bad misses which would render an adaptive website very ugly indeed on Google s flagship device on DA

12 Huawei U8230 (Android 1.5) Mozilla/5.0 (Linux; U; Android 1.5; ru-ru; U8230 Build/CRB17) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ A much less common Android phone. Is this the droid* we re looking for? Detected As: HUAWEI U8230 Huawei U8230 HTC Magic A mismatch for HTC Magic, but WURFL spots it 65c49ea8e90b1cf20f9e86d931283b3b huawei_u8230_ver Mozilla/5.0 (Linux; U; Android 1.5; ru-ru; U8230 Build/CRB17) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 1.5; xx-xx; U8230 Build/CRB17) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 1.5; ru-r All Russians are Magic to DeviceAtlas. Screensize: 320x x x480 The HTC Magic and the Huawei are the same screensize: maybe the most common size for Android 1.5 devices. MIDP version: No No No MP3 Support: Yes Yes Yes 3GPP Support: Yes Yes Yes Detected Browser: Mobile Safari Android Webkit Not Available Detected OS: Android 1.5 Android 1.5 Android Despite including 1.5 as part of the detection string, DA misses the version again. Performance Mark: 5/5 5/5 3/5 DeviceAtlas misses the device, but gets the core features right. * Droid is a registered trademark of LucasFilm

13 Windows Mobile Devices The main problem with Windows Mobile Devices used to be that there were no identifying UA features. These days, ID information can vary greatly from device to device, and there are multiple different browsers the device can run. Any engine which is not actively scanning the tokens of a useragent will generate many misses on novel/new useragents. You can generate more Windows Mobile detection tables like this at

14 Orange SPV M600 (WinMo 5.0) Mozilla (Windows Mobile; PPC; 240x320; M600; OpVer ; Opera Mobi/35166; U; en) Presto/2.2.1 Opera/9.7 An identifiable Windows Mobile Device running Opera Mobile: how will everyone cope? Detected As: Orange SPV M600 Opera Mobi 4 Unknown Vendor Unknown Model Both WURFL and DR have a problem with this Windows Mobile running Opera 3b87c919dc4d1a7d191ebd2c4d opera_mobi_ver4 WURFL detects this as an XHTML generic device, which for markup would be OK. Mozilla (Windows Mobile; PPC; 240x320; M600; OpVer ; Opera Mobi/35166; U; en) Presto/2.2.1 Opera/9.7 Opera/9.7 (Windows Mobile; PPC; Opera Mobi/35166; U; en) Presto/2.2.1 Mozilla ( WURFL fixates on the browser Screensize: 240x x160 Not Available DR gets this MIDP version: 2.0 No No This Windows Mobile comes with a JVM. MP3 Support: Yes No No A medium miss, since this is a relatively old device now 3GPP Support: Yes No No although it s still capable of at least H.263! Detected Browser: Opera Mobile Opera Mini 4 Not Available The change of browser from default really threw the other systems, but this isn t Opera Mini. Detected OS: Windows CE 5.1 Not Available Not Available Detected DP: Windows Mobile 5.0 Not Available Not Available Performance Mark: 5/5 0/5 0/5 A sidegrade to an old phone causes major ID problems.

15 Opera Windows Mobile Browser (WinMo x.x) Opera/9.80 (Windows Mobile; WCE; Opera Mobi/WMD-50369; U; ru) Presto/ Version/10.00 An unidentifiable Windows Mobile Device running Opera Mobile: how will everyone cope? Detected As: Opera/9.80 (Windows Mobile; WCE; Opera Mobi/WMD-50369; U; ru) Presto/ Version/10.00 (UserAgent) fd82d16c6d40f 3b66 Opera/9.80 (Windows Mobile; WCE; Opera Mobi/WMD-50369; U; ru) Presto/ Version/10.00 Opera Mini 4 opera_mini_ver4_sub Opera/9.80 (J2ME/MIDP; Opera Mini/ /2444 Unknown Vendor Unknown Model Opera/9.80 (W Everyone failed on this, since there s no model to get. Opera Mini choice is a bit odd. Match here is to WML generic rather than generic_xhtml. Opera would probably have preferred XHTML. WURFL couldn t do anything with this. DeviceAtlas ran out of data at W. Screensize: 240x x160 Not Available This is DR s generic fallback for Windows Mobile. It might well be wrong. MIDP version: No No No The true value of this is indeterminate. It s quite likely that this device has a JVM, but Windows Mobile is provided without one, and there s no WM version number to go on. MP3 Support: No No No Since WinMo supports Media player, DetectRight has slipped up here: however, it would also have checked accept strings to modify this value. 3GPP Support: No No No This is indeterminate, though again DR would have checked the accept strings for more clues. Detected Browser: Opera Mobile WMD Not Available Not Available Detected OS: Not Available Not Available Not Available WCE obviously stands for Windows CE, but DR missed this. Detected DP: Windows Mobile 0 DR gets WM right, but no version Performance Mark: 3/5 1/5 (got the browser manufacturer right) 0/5 Summary of detection performance (human generated)

16 HTC T7385 Touch Pro2 (WinMo 6.0) Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) PPC; 480x800; HTC_Touch_Pro2_T7385-Orange; OpVer An advanced HTC device: should be straightforward! Detected As: HTC T7385 Touch Pro2 HTC Touch Diamond2 HTC Touch Diamond2 (T5353) WURFL fails on the ID. DeviceAtlas chooses a completely different HTC Touch, with drastic results. 510db7dda3e10a2e23fa3b772d htc_touchdiamond2_ver1_subor ange Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) PPC; 480x800; HTC_Touch_Pro2_T7385-Orange; OpVer Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) PPC; 480x800; HTC_Touch_Diamond2_T5353- Orange; OpVer WURFL has fallen back to the MS Mobile Browser ID Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) PPC; 4 This is very odd. DeviceAtlas has stopped at the 4 in 480, and come up with a T5353 which it says has screensize 240 (not 480) x 800. It s wrong, but it s wrong interestingly! Screensize: 480x x x800 DeviceAtlas wrong, despite using the screen width in the UA as a guide. And WURFL is even more incorrect, again despite the UA giving the game away. MIDP version: No No No MP3 Support: Yes Yes Yes WURFL misses MP3 support thanks to conservative browser specs. (Mozilla 2.0 assumed). 3GPP Support: Yes Yes No It s odd that this device should support video but not MP3 in WURFL s output. DeviceAtlas is wrong here, and possibly for the Touch Diamond2 as well. Detected Browser: Mobile Internet Explorer 8.1 Microsoft Mobile Explorer Not Available WURFL flunks it here Detected OS: Windows CE 5.2 Windows Mobile OS 6.1 Windows 6.1 DA is mixing up OS and Developer Platform in its fields Detected DP: Windows Mobile Developer Platform Performance Mark: 5/5 1/5 1/5 A mixed bag of fail, mostly.

17 HTC P4500 TyTN Touch Pro2 (WinMo 6.0) HTC_TyTN-Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; PPC) An oldie but a goodie: how will the systems react? Detected As: HTC P4500 TyTN HTC Hermes HTC TyTN II It s not a TyTN II. 56d4c31e011916aced79af8921 ef2971 HTC_TyTN-Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; PPC) htc_tytnii_ver1_subua HTC_TyTN-Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPC; 240x320; HTC TyTN2) HTC_TyTN- What s odd about this is that DA detects this as the TyTN II based on the string TyTN. And then gets it wrong because of that assumption. Screensize: 240x x x320 TyTNs are similar enough for the data to be useful. MIDP version: No Only DR knew about HTC s JVM. MP3 Support: Yes Yes Yes It can. 3GPP Support: Yes Yes No UAProfile says it can Detected Browser: Pocket Internet Explorer 4.1 Microsoft Mobile Explorer 6.12 Not Available What on earth is that browser version? Detected OS: Windows CE 3.0 Windows Mobile OS Windows Everybody gets this, only DR gets the version number though but gets it wrong Detected DP: Windows Mobile DR misses the Windows Mobile version here Performance Mark: 4.5/5 3/5 2/5 TyTN II isn t a great match, but it was OK

18 Samsung GT-i8000 (Omnia 2) (WinMo 6.1/6.5) SAMSUNG-GT-i8000Orange/NXXJA1 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) A nice Samsung device from Orange. How will the systems possibly cope? Detected As: Samsung GT-i8000 Generic XHTML Samsung GT-i8000 DeviceAtlas nails this one, as does DR. 8929d3990b97f33d7fc03450b4160bc d SAMSUNG-GT-i8000Orange/NXXJA1 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0) generic_xhtml Mozz SAMSUNG-GT-i Even though DeviceAtlas nailed this one, it s been a bit premature with the recognition, since this bit of UA string is shared with at least 7 other live Samsung models. There are more Uas from the i8000, so it worked out this time, but that was pretty much luck. Screensize: 480x x92 480x800 Correct from DA. WURFL is still stuck in fallback land. MIDP version: 2.1 No 2.1 MP3 Support: Yes No Yes 3GPP Support: Yes No No It does actually support video, so DA has this wrong. Detected Browser: Mobile Internet Explorer 8.1 Not Available Not Available There is a lot of difference between MME and MobileIE! Detected OS: Windows CE 5.2 Not Available Windows Mobile 6.5 Professional Although DA is talking about a developer platform, not an OS as such. it got it right. Detected DP: Windows Mobile 6.0 Windows Mobile DR got this wrong. Performance Mark: 4/5 0/5 4/5 DA got the right result, but from a dubious heuristic.

19 RIM BlackBerry Devices BlackBerry user agents are not hugely challenging to a detection system. The challenge is in picking up alterations, and getting the OS right. You can generate more Windows Mobile detection tables like this at

20 BlackBerry 9700 (RIM OS 5.0) BlackBerry9700/ Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/114 A great little juicy BlackBerry. Will the systems suck at it? Detected As: RIM BlackBerry 9700 RIM BlackBerry 9700 (Onyx) RIM BlackBerry 9700/Onyx Complete failure for WURFL. DA and DR nail it. fe8de02d1e25d706f4b75259c4cb 9fa6 blackberry9700_ver BlackBerry9700/ Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/114 BlackBerry9700/ Profile/MIDP-2.1 Configuration/CLDC- 1.1 VendorID/175 BlackBerry97 This seems presumptive from DA to use so few digits on the ID. This implies that they have no other models in the 97xx range, but it s unwise to assume there will never be. Screensize: 480x x x360 DA and DR are correct of course. MIDP version: Even the User agent tells us this, but WURFL doesn t have a field for MIDP 2.1. MP3 Support: Yes Yes Yes Correct from DA and DR 3GPP Support: Yes Yes Yes Correct from DA and DR Detected Browser: RIM Browser 5.0 BlackBerry 4.0 Not Available DA doesn t contain browser information and WURFL missed the detection. Detected OS: RIM OS 5.0 RIM OS 4.0 RIM OS DA and DR are on safe ground here. WURFL is a bit behind the times. Performance Mark: 5/5 4/5 5/5 DA Nails it until the 9777 comes along!

21 BlackBerry 8520 Curve (RIM OS 4.6) BlackBerry8520/ Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/118 Will this model serve the engines a curve-ball? Detected As: RIM BlackBerry 8520 RIM BlackBerry 8520 (Curve) RIM BlackBerry 8520/Curve WURFL s BlackBerry fallback works here for version 4, but it still doesn t get the model. eff177782e13eeb542ad3ce16d78 b008 blackberry8520_ver The record the data matches in the system. Generic IDs are not good. BlackBerry8520/ Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/118 BlackBerry8520/ Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/100 BlackBerry852 Not too bad from DA, but still reliant on BlackBerry not releasing any more 852x devices in the near future. Screensize: 320x x x240 DR and DA right: WURFL wrong. MIDP version: DA and DR right. MP3 Support: Yes No Yes DA and DR right. 3GPP Support: Yes Yes Yes I think I m doing this wrong. Detected Browser: RIM Browser 4.6 BlackBerry Not Available DR gets this right. Detected OS: RIM OS 4.6 RIM OS RIM OS DA and DR right: WURFL in the right ballpark. Performance Mark: 5/5 4/5 (MP3 wrong) 5/5 Summary of detection performance (human generated)

22 BlackBerry 8310 (RIM OS 4.2) BlackBerry8310/4.2.2 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/124 UP.Browser/ An 8310, but not running BlackBerry Browser. Will anyone notice? Detected As: RIM BlackBerry 8310 RIM BlackBerry 8310 (Curve) RIM Blackberry 8310 DA and DR got this right c4542d a d1d 3f4c5 blackberry8310_ver1_sub BlackBerry8310/4.2.2 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/124 UP.Browser/ BlackBerry8310/4.2.2 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/124 BlackBerry831 Again relying on an implied zero from DA. Screensize: 320x x x240 DA and DR correct MIDP version: DR and DA correct. MP3 Support: Yes Yes Yes DR and DA correct. 3GPP Support: Yes Yes Yes DR and DA correct. Detected Browser: Openwave 5.0 BlackBerry Not Available Only DetectRight noticed or cared that this isn t running a RIM browser. This might well have an implication for preferred markup. Detected OS: RIM OS 4.2 RIM OS RIM OS Everyone got this Performance Mark: 5/5 4/5 5/5

23 BlackBerry 9650 (RIM OS 5.0) BlackBerry9650/ Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/104 A regular BlackBerry. Detected As: RIM BlackBerry 9650 Device Match Failed RIM BlackBerry Tour 9630 DA missed this one because of its overly-optimistic digit matching. WURFL seems to have failed to fall back to BlackBerry ab92e5913fe1dda6b201359f22d d415 BlackBerry9650/ Profile/MIDP-2.1 Configuration/CLDC-1.1 VendorID/104 generic_xhtml Mozz BlackBerry96 The overly ambitious digit matching does have some consequences later, since DA has detected an older device than it really is Screensize: 480x x92 480x360 Though the screensize is right MIDP version: 2.1 No 2 The user agent tells you it s 2.1, so this is a pretty bad miss all round. It might be important to some app sellers. MP3 Support: No No Yes What is DR doing here? That s really strange. The device should support MP3. 3GPP Support: Yes No Yes DA and DR get this Detected Browser: RIM Browser 5.0 Not Available Not Available DR does it correctly. Detected OS: RIM OS 5.0 Not Available RIM OS Only DR gets this right, since it s not ignoring evidence right in front of it. Performance Mark: 4/5 0/5 3/5

24 Apple iphone OS Devices ipod user agents were until recently a challenge to WURFL, but this problem has been fixed in the latest API iteration. The amount of apps available for iphone means that not all iphone accesses follow the Apple standard pattern. Other browsers that namecheckthe iphone would need to be checked for using deep user agent scanning. The detections here show that for standard iphone accesses, all of the engines perform adequately. You can generate more iphone OS detection tables like this at

25 Apple iphone (iphone OS 3.1) Mozilla/5.0 (iphone; U; CPU iphone OS 3_1_3 like Mac OS X; de-de) AppleWebKit/ (KHTML, like Gecko) Mobile/7E18 The iconic device of the millennium so far. Detected As: Apple iphone Apple iphone Apple iphone All correct 6eeb0707bcd564f39c91cc669df5 dd60 Mozilla/5.0 (iphone; U; CPU iphone OS 3_1_3 like Mac OS X; de-de) AppleWebKit/ (KHTML, like Gecko) apple_iphone_ver It s worrying that WURFL thinks this is a V1 Mozilla/5.0 (iphone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A538a Safari/419.3 Mozilla/5.0 (iphone; U; C This is odd. WURFL has used a version 3.0 useragent, but the OS is down as 1.0. Equally, DeviceAtlas has the OS at 3.1.2, but the user agent used to detect it doesn t get as far as a version number: which means this is a guess. Screensize: 320x x x480 An iconic phone has an iconic screensize. With icons, of course. MIDP version: No No No Apple give Sun no break here. MP3 Support: Yes Yes Yes An entire economy depends on this. 3GPP Support: Yes Yes Yes and this Detected Browser: Apple WebKit Safari Not Available Both DR and WURFL are correct: this is a reversal of the Android Webkit/Mobile safari incident. Detected OS: iphone OS 3.1 iphone OS 1.0 OSX DA got this right, but only by coincidence. Performance Mark: 5/5 4/5 5/5 Everyone did OK

26 Apple ipod Touch (iphone OS 3.1) Mozilla/5.0 (ipod; U; CPU iphone OS 3_1_3 like Mac OS X; ja-jp) AppleWebKit/ (KHTML, like Gecko) Mobile/7E18 (via babelfish.yahoo.com) Another iphone with a multilinguistic cheer this time, courtesy of Yahoo. Detected As: Apple ipod Touch Apple ipod Touch Apple ipod Touch Only the newest version of the WURFL API gets this right: previous versions would detect this as an iphone due to an inappropriate matching algorithm. 496b56a364fc314814b9f30de13a d3e9 Mozilla/5.0 (ipod; U; CPU iphone OS 3_1_3 like Mac OS X; ja-jp) AppleWebKit/ (KHTML, like Gecko) Mobile/7E18 (via babelfish.yahoo.com) apple_ipod_touch_ver3_1_ WURFL makes this an iphone (see bug) Mozilla/5.0 (ipod; U; CPU iphone OS 3_1_3 like Mac OS X; xx-xx) AppleWebKit/ (KHTML, like Gecko) Version/4.0 Mobile/7E16 Safari/ Mozilla/5.0 (ipo If Apple ever release an ipoo then DA is in trouble. And I wouldn t put it past them, frankly. Screensize: 320x x x480 Correct MIDP version: No No No Correct MP3 Support: Yes Yes Yes Correct 3GPP Support: Yes Yes Yes Correct Detected Browser: Apple WebKit Safari Not Available Detected OS: iphone OS 3.1 iphone OS OSX 3.0 DA has an odd way of representing the iphone OS, and gets it wrong. Detected DP: iphone This is really OS, but DA s field structure doesn t differentiate between Apple OSX iphone style, and Apple OSX desktop style. Performance Mark: 5/5 5/5 4/5 Summary of detection performance (human generated)

27 Samsung Devices There are large numbers of varying Samsung devices: Android, Windows Mobile, proprietary, CDMA and GSM. The prolific nature of Samsung s release schedule means that devices are likely to be missing from device data engines Samsung s habit of prefixing devices and having marketing names means that representation of device names is often inconsistent within the standard databases. You can generate more Samsung detection tables like this at

28 Samsung GT-i7500 Galaxy (Android 1.5) Mozilla/5.0 (Linux; U; Android 1.5; ja-jp; Galaxy Build/CUPCAKE) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ Samsung s Galaxy phone has many UA variations: how is it handled? Detected As: Samsung GT-i7500 Samsung Galaxy Unknown Vendor Unknown Model 06d5da360bbd1d067ef2cd9e97ea 150b Mozilla/5.0 (Linux; U; Android 1.5; ja-jp; Galaxy Build/CUPCAKE) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ samsung_galaxy_ver1_es Mozilla/5.0 (Linux; U; Android 1.5; xx-xx; Galaxy Build/CUPCAKE) AppleWebKit/ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/ Mozilla/5.0 (Linux; U; Android 1.5; DR and WURFL get this DA gets to Android 1.5 and gives up when it encounters the j in ja-jp. Strange that it doesn t fall back to some kind of generic Android 1.5 dataset. Screensize: 320x x240 Not Available DR gets this right. WURFL should get this right, having done the detection, but it still picking up Android SDK Screensizes MIDP version: No No No Who needs J2ME, mmh? MP3 Support: Yes Yes No DA wrong 3GPP Support: Yes Yes No DA wrong. Detected Browser: Mobile Safari Android Webkit Not Available Detected OS: Android 1.5 Android 1.5 Not Available DA missed it Performance Mark: 5/5 5/5 0/5 WURFL up there, DA down there.

29 Samsung GT-B7610 (WinMo 6.1) Mozilla (Windows NT 5.1; U; en) SAMSUNG-GT-B7610 Opera/9.5 An easy useragent: or is it? Claiming to be Windows NT 5.1 and using Opera?. Detected As: Samsung GT-B7610 Opera 9 Unknown Vendor Unknown Model Only DR gets this right bf9cda47b60e2d15ec70a6a9 bb21dc5d Mozilla (Windows NT 5.1; U; en) SAMSUNG-GT-B7610 Opera/9.5 opera_9 Opera would be happy with WURFL s Opera/9 Mozilla ( WURFL missed most of the meat of the string, and DA gave up far too easily. Screensize: 480x x600 Not Available DR gets this right. WURFL appears to think this is not a mobile device at all. Oops! This user might never see the premium mobile content. MIDP version: 2.1 No No Not in the UA, but present and correct. MP3 Support: Yes No No DR Correct 3GPP Support: Yes No No DR Correct Detected Browser: Opera 9.5 Opera 9 Not Available DR Correct Detected OS: Windows CE 5.2 Not Available Not Available DR Correct Detected DP: Windows Mobile 6.1 DR Correct Performance Mark: 5/5 1/5 0/5 WURFL gets two points for getting the browser right, but loses one for not detecting it as a mobile device.

30 Samsung GT-B5310 SAMSUNG-GT-B5310/B5310MMJC1 SHP/VPP/R5 Dolfin/1.5 Nextreaming SMM-MMS/1.2.0 profile/midp-2.1 configuration/cldc-1.1 A low-end Samsung device. If Dolfin is a browser then people had better start detecting it! Detected As: Samsung GT-B5310 Samsung GT-B5310 Samsung GT-B5310 WURFL back to generic 467d0738d72c31fd1bcfad0dc696e102 samsung_gt_b5310_ ver1 SAMSUNG-GT-B5310/B5310MMJC1 SHP/VPP/R5 Dolfin/1.5 Nextreaming SMM-MMS/1.2.0 profile/midp-2.1 configuration/cldc-1.1 SAMSUNG-GT- B5310/B5310ACIK1 SHP/VPP/R5 Dolfin/1.5 Nextreaming SMM- MMS/1.2.0 profile/midp-2.1 configuration/cldc SAMSUNG-GT-B53 Screensize: 240x x x320 DA and DR are correct DA s presumptuous number matching makes it a hostage to fortune again, should there be a B5315. MIDP version: No How did DA miss this? It s in the user agent, and we know they detected the correct device! WURFL again suffers from not having a MIDP2.1 field. MP3 Support: Yes Yes Yes DR and DA correct 3GPP Support: Yes No No DA and WURFL missed this one. Detected Browser: Not Available Not Available Not Available Unless the browser is Dolfin v 1.5, they all missed this. Detected OS: Not Available Not Available Not Available Proprietary OS. Performance Mark: 5/5 (no obvious browser) 4/5 (missed the video) 3/5 DeviceAtlas detects correctly, but lets itself down with two odd data results. WURFL misses video support.

31 Samsung SGH-D407 SEC-SGHD407 Old school Samsung Device. Should be easy, right? Detected As: Samsung SGH-D407 Samsung SGH-D407 Samsung SGH-D407 All OK f633c5d93dfd637473c1e3 2102c7835b sec_sghd407_ver All OK SEC-SGHD407 SEC-SGHD407/1.0 TSS/2.5 SEC-SGHD407 All OK Screensize: 128x x x160 All OK MIDP version: No DA and WURFL underestimate this dark horse of a phone! MP3 Support: Yes Yes No MP3 supported? Mistakes here could mean customers missed. 3GPP Support: Yes Yes No Does this support 3GPP video (either H.263 or H.264)? Detected Browser: Not Available Not Available Not Available Actually someone should have detected TSS 2.5 here. Detected OS: Not Available Not Available Not Available Proprietary OS Performance Mark: 5/5 4/5 2/5 DA missed more data in this one

32 Sony Ericsson Devices Sony Ericsson devices do not tax the device identification algorithms much, since they have historically used tidy useragents with device information front-loaded: e.g. SonyEricssonZ550i/R6CA You can generate more Samsung detection tables like this at

33 Sony Ericsson Z520i sonyericssonz520i/ucweb /70/999 Another browser has got hold of this one. Will everyone detect it properly? Detected As: Sony Ericsson Z520i Device Match Failed Device Match Failed Nothing doing except for DR 8c1003a4a35deaa8ec40e6c7 d34e6b2e generic Interestingly, an additional test showed that Tera-WURFL detects this as a web browser, not a mobile device. sonyericssonz520i/ucweb /70/999 sonyericsson Well, at least DA knows it s from Sony Ericsson! Screensize: 128x160 90x40 Not Available DR Correct. MIDP version: 2.0 No No DR Correct. MP3 Support: Yes No No DR Correct. 3GPP Support: Yes No No DR Correct. Detected Browser: UCWEB 709 Not Available Not Available DR Correct. Detected OS: Not Available Not Available Not Available Proprietary OS Performance Mark: 5/5 0/5 0/5 Summary of detection performance (human generated)

34 Sony Ericsson K790i SonyEricssonK790i/R8BF Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0,sonyericssonk790i/UC Browser /70/351 Another useragent hijacked by UCBrowser. Detected As: Sony Ericsson K790i SonyEricsson K790i Sony Ericsson K790i All systems got this right ab659d6ce70bb0b19d6adb77d1 4c7cf3 SonyEricssonK790i/R8BF Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0,sonyericssonk7 90i/UC Browser /70/351 sonyericsson_k790i_ver1_subr1jc The record the data matches in the system. Generic IDs are not good. SonyEricssonK790i/R1JC Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1 SonyEricssonK790i This UA plays to DA s strengths. The WURFL UA picked out is slightly less of a good match because of the browser discrepency Screensize: 240x x x320 MIDP version: All correct MP3 Support: Yes Yes Yes MP3 supported? Mistakes here could mean customers missed. 3GPP Support: Yes Yes Yes Does this support 3GPP video (either H.263 or H.264)? Detected Browser: UNTRUSTED 1.0 Access Netfront 3.3 Not Available DR also failed to spot UCBrowser lurking on the end, but this shows its deductive reasoning picking UNTRUSTED/1.0 as the main brower (I suspect this access was made from a JVM then hijacked. Detected OS: Not Available Not Available Not Available Proprietary OS. More information from DR would be nice. Performance Mark: 4/5 3/5 3.5/5 (there s got to be a penalty there somewhere for not bothering with browsers!) Summary of detection performance (human generated)

35 Sony Ericsson W810i SonyEricssonW810i/R4EA Java/SEMC-Java/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0 A perfectly good SE phone but currently using Sony Ericsson s Java browser. Detected As: Sony Ericsson W810i SonyEricsson W810i Sony Ericsson W810i So far so good 75ac5b9d49cedb80dd18a8c97b3 6dc8b sonyericsson_w810i_subr4ea SonyEricssonW810i/R4EA Java/SEMC-Java/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0 SonyEricssonW810i/R4EA Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1 SonyEricssonW810i Once again WURFL has gone for a matching strategy which uses NetFront as the browser. That s not good. Screensize: 176x x x220 Screensize is very important. A failed detection can still get this right. MIDP version: A bad miss for DA. MP3 Support: Yes Yes Yes MP3 supported? Mistakes here could mean customers missed. 3GPP Support: Yes Yes Yes Does this support 3GPP video (either H.263 or H.264)? Detected Browser: SEMC Java 2.0 Access Netfront 3.3 Not Available This mistake by WURFL has possible implications for markup (DR would also interrogate the accept strings for help in a real-time situation). At least it gives browser information. Detected OS: Not Available Not Available Not Available Proprietary OS Detected DP: Not Available 0 JavaPlatform 6 DR should have this information, but doesn t. Performance Mark: 4/5 3/5 3/5 Summary of detection performance (human generated)

36 Sony Ericsson K800i SonyEricssonK800i/R1JE Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0;Opera/9.60 (J2ME/MIDP;Opera Mini/ Mod.by.Handler/960; U;en-US)flameblur/2.2.0 A simple SE device hijacked by a modded Opera Mini. Could be trouble! Detected As: Sony Ericsson K800i SonyEricsson K800i Sony Ericsson K800i The classic SonyEricsson beginning to the string makes this an easy match 07e3ec46ec768502b1c03b27a78 3c491 SonyEricssonK800i/R1JE Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0;Opera/9.60 (J2ME/MIDP;Opera Mini/ Mod.by.Handler/9 60; U;en-US)flameblur/2.2.0 sonyericsson_k800i_ver1_subr1jc SonyEricssonK800i/R1JC Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1 SonyEricssonK800i/ Again, the matching strategy for WURFL misses a crucial piece of the puzzle. Screensize: 240x x x320 Screensize is very important. A failed detection can still get this right. MIDP version: OK MP3 Support: Yes Yes Yes MP3 supported? Mistakes here could mean customers missed. 3GPP Support: Yes Yes Yes Does this support 3GPP video (either H.263 or H.264)? Detected Browser: Opera Mini 5.0 Access Netfront 3.3 Not Available Not knowing it s Opera Mini could have ramifications for content delivery. Detected OS: Not Available Not Available Not Available Proprietary OS Detected DP: Not Available JavaPlatform 7 DR should have this. Performance Mark: 4.5/5 (mark deducted for not having DP) 3/5 4.5/5 (DA sidestepped the difficult browser bit) Summary of detection performance (human generated)

37 Sony Ericsson X1i (WinMo 6.1) Mozilla (Windows NT 5.1; SonyEricssonX1i/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1; U) gzip(gfe) (via translate.google.com) Opera/9.50 A bit of a mess this one. First, the device ID is inside a Mozilla container: always bad for detection mechanisms. Secondly, we ve got a transcoder signature on the end! This is a pretty good phone, too. And notice it s claiming Windows NT 5.1 compatibility? Detected As: Sony Ericsson X1i Device Match Failed Unknown Vendor Unknown Model 73d3367eec6fc04f37028f716705c 987 Mozilla (Windows NT 5.1; SonyEricssonX1i/1.0 Profile/MIDP- 2.0 Configuration/CLDC-1.1; U) gzip(gfe) (via translate.google.com) Opera/9.50 generic_xhtml Only DR gets this right. Mozz Mozilla ( DA s tree strategy has an epic fail before getting to the telltale data, and WURFL falls straight through. Screensize: 480x x92 Not Available DR Correct MIDP version: 2.0 No No DR Correct. MP3 Support: Yes No No DR Correct 3GPP Support: Yes No No DR Correct (no, seriously) Detected Browser: Opera 9.5 Not Available Not Available Because DR does deep substring analysis, it doesn t matter where Opera appears in the UA. Detected OS: Windows CE Not Available Not Available DR got this from its contains data: lists of components shipped with devices which are merged or swapped out in real-time with other detected components. Detected DP: Windows Mobile Developer Platform Performance Mark: 5/5 0/5 0/5 Summary of detection performance (human generated)

38 Sony Ericsson K550i (Symbian) FIREFOX_SPEEDY(compatible; MSIE 6.0; Symbian OS; SonyEricsson K550i/R6B/ ; 9399) Opera 9.85 [en] >> You see some strange useragents on the Internet, and this one is pretty odd. Detected As: Sony Ericsson K550i SonyEricsson P800 Unknown Vendor Unknown Model 751d63f90936ff7cf3b5a f21b FIREFOX_SPEEDY(compatible; MSIE 6.0; Symbian OS; SonyEricsson K550i/R6B/ ; 9399) Opera 9.85 [en] >> opera_sonyericsson_p800_ver 1_sub630 Mozilla/4.0 (compatible; MSIE 5.0; Symbian OS; SonyEricsson P800; 305) Opera 6.30 [en] F DR gets this right. Interestingly, Tera- WURFL misses this entirely, making it a generic xhtml. The record the data matches in the system. Generic IDs are not good. F?? F??? At least WURFL s matching algorithm had a try!! Interesting that DA doesn t even have the string Firefox in it Screensize: 176x x320 Not Available Too big by WURFL. MIDP version: No Somehow I don t think this UA owner is a huge app buyer, but you never know MP3 Support: Yes Yes No Yep 3GPP Support: No Yes No Not a video phone. Detected Browser: Opera 9.8 Opera 6.30 Not Available Right browser, wrong version. Which is still pretty good. Detected OS: Symbian OS Symbian OS Not Available Detected OK by DR and WURFL. Performance Mark: 5/5 2.5/5 (device epic fail, marks for browser and DP) 0/5 Summary of detection performance (human generated)

39 Vodafone devices Vodafone has its own useragent structure it likes to follow, but it s also inconsistent across time, even within useragents for the same model. Vodafone s structuring of the useragent string makes it very difficult for substring matches based on the beginning of the useragent, and also makes least distance detection problematic. You can generate more Samsung detection tables like this at

40 Samsung GT-B2100 (Vodafone) Vodafone/1.0/SAMSUNG-B2100V/BUIA2/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/ c (GUI) MMP/2.0 Vodafone do a lot of mucking about with their UAs. Detected As: Samsung GT-B2100 Samsung B2100 Samsung B2100 The official name of this device is GT- B2100. Device catalogues often have some devices with the prefix and some without, which is messy and appears unprofessional in a pick list. 10fa685ebfee1d26c9d58c0cba Vodafone/1.0/SAMSUNG- B2100V/BUIA2/1.0 Profile/MIDP- 2.0 Configuration/CLDC-1.1 UP.Browser/ c (GUI) MMP/2.0 samsung_b2100v_ver Pretty exact match here. Vodafone/1.0/SAMSUNG- B2100V/BUIA2/1.0 Profile/MIDP- 2.0 Configuration/CLDC-1.1 UP.Browser/ c (GUI) MMP/2.0 Vodafone/1.0/SAMSUNG-B DeviceAtlas is lucky here that its own internal problem space this time matches the actual problem space: there aren t any more Bxxxx models from Samsung sharing this UA structure. WURFL seems to have seen this UA before. Screensize: 128x x x160 Screensize is very important. A failed detection can still get this right. MIDP version: 2.0 No No Bad MIDP miss there. MP3 Support: Yes Yes Yes MP3 supported? Mistakes here could mean customers missed. 3GPP Support: Yes No Yes WURFL has this wrong. Detected Browser: Openwave 6.2 Openwave Mobile Browser 6.2 Not Available All present and correct. It s understandable why DA leaves browser out of it: their matching algorithm would make the results a complete mess. Detected OS: Not Available Not Available Not Available Proprietary OS Performance Mark: 5/5 4/5 5/5 (but no browser info) Judging by the browser age, this UA has been around a while.

41 Vodafone V1240 VodafoneV1240/B037 Browser/NetFront/3.5 MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3 There s a lot of information here in this UA how will the engines cope? Detected As: Vodafone v1240 Huawei V1240 Unknown Vendor Unknown Model 51704e9c58cf13d4cdef98a4b618 12ca VodafoneV1240/B037 Browser/NetFront/3.5 MMS/Obigo- MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV- Player/5.3 huawei_v1240_ver1 VodafoneV1240/B037 Browser/NetFront/3.5 MMS/Obigo- MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV- Player/5.3 Vodafone Screensize: 240x x320 Not Available DA fails. MIDP version: No DA fails. MP3 Support: Yes Yes No DA fails. There s an interesting point here, which is that this device is both of these things. DetectRight has a big list of AKAs, which also has WURFL s main name in it for this device. We called it a Vodafone V1240 because Vodafone sell it as a Vodafone branded device, and it s only made by Huawei: though they also sell it under their own name with a different UA. Not much luck with DA, but WURFL has something. 3GPP Support: No No No This must be wrong. This device has a QTV player in it, which ought to handle video. I think all the systems are wrong. Detected Browser: NetFront 3.5 Access Netfront 3.5 Not Available DR and WURFL correct Detected OS: Windows CE 5.1 Windows Mobile OS 5 Not Available Detected DP: Windows Mobile Developer Platform Performance Mark: 4/5 4/5 0/5 Summary of detection performance (human generated)

42 LG HB620T Vodafone/1.0/LG-HB620T/V10a Browser/Obigo-Q05A/3.12 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1 An LG model lurking in here. Will it get spotted? Detected As: LG HB620T LG KU990 LG HB620T WURFL guesses wrong based on very similar useragents: similar enough to confuse the LD algorithm and make it ditch the model name. 2f e9fdf5d7e50 bfc1 Vodafone/1.0/LG-HB620T/V10a Browser/Obigo-Q05A/3.12 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1 lg_ku990_ver1_subv10c Vodafone/1.0/LG-KU990/V10c Browser/Obigo-Q05A/3.6 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Vodafone/1.0/LG-H DA s strategy worked this time to be fair, if other models came along they knew about, the tree would split properly at another point. But it depends on DA knowing about it. WURFL s distance match has been overwhelmed by the similarities between the useragents, but missed the vital model information. Screensize: 320x x x240 WURFL gets this wrong, since it thinks this is another device. MIDP version: I m sure WURFL would put 2.1 if it had a 2.1 field. MP3 Support: Yes Yes Yes OK 3GPP Support: Yes Yes No No video support of any kind, DA? Isn t that a bit mean? Detected Browser: Obigo Q05A Teleca-Obigo 5.0 Not Available Both good choices. Performance Mark: 5/5 2/5 (Model is wrong, markup would probably have worked) 4/5 DR and DA get this one.

43 Vodafone 725 Vodafone/1.0/0Vodafone725/B114 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3 UNTRUSTED/1.0 Vodafone do a lot of mucking about with their UAs. Detected As: Vodafone 725 Huawei Vodafone 725 Huawei V720 WURFL s result shows how difficult it is to stay consistent with model names when you ve got multiple parties and/or marketing names involved. DA got it actually badly wrong. bd8b19b04fab81be89af6cd229081a9d huawei_vf725_ver1_subvodaf one10 Vodafone/1.0/0Vodafone725/B114 Browser/Obigo-Browser/Q05A MMS/Obigo- MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3 UNTRUSTED/1.0 Vodafone/1.0/0Vodafone725/B1 12 Browser/Obigo- Browser/Q05A MMS/Obigo- MMS/Q05A SyncML/HW- SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/ Vodafone/1.0/0Vodafone72 Screensize: 240x x x220 DA wrong. MIDP version: Everyone got this Device Atlas s premature user agent matching bites it in the rear end here, since the phone it s detected is substantially different to the one we re seeing. MP3 Support: Yes Yes Yes MP3 supported? Mistakes here could mean customers missed. 3GPP Support: Yes Yes No Misdetection costs opportunities Detected Browser: Obigo Q05A Teleca-Obigo Q05A Not Available This one raised my Obigo brow Detected OS: Not Available Not Available BREW 3.1 Java and BREW in the same device? BREW is more of a developer platform than an OS (it s normally coupled with REX OS). Performance Mark: 5/5 5/5 2/5 DA shows its limitations here