Test Results
In this page, the results of the tests are presented.
Power consumption tests
Several problems came up when testing the power consumption of the boards and computer systems present in the Locolab. In order to correctly measure the power consumption, the power supply needs to be the same for all equipment measured. However, the Intel Icbook comes with it's own PSU, and the Ebox 4300 also comes with it's own powersupply. We decided to use the alternative powersupplies, as the efficiency will not be dramatically different, as shown in the paragraph of the powersupply testing. The second thing we tried to keep uniform was the harddisk, which also proved to be impossible as some boards only have SATA connections, and others only have IDE connections. Since this was a specific issue with the Intel D201GLY board (which does not come with a SATA connection) we decided to do two tests with the Intel 945GCLF: One test with the SATA 2.5” disk we used in the other tests, and one test with the 3.5” IDE disk we had to use in the test with the D201GLY board. The difference in the two measurements is subtracted from the results of the D201GLY.
In the table below the power consumption test results are presented.
| Motherboard | CPU | HDD used | Power Supply used | CPU IDLE | CPU 100% |
|---|---|---|---|---|---|
| INTEL MOTHERBOARD D945GCLF | Intel Atom Silverthorne 1660 Mhz 45nm | Toshiba MK8034GSX 2.5 SATA 80GB 5400 RPM 8m | PicoPSU60 | 23 | 30 |
| INTEL MOTHERBOARD D945GCLF | Intel Atom Silverthorne 1660 Mhz 45nm | Samsung SP0842N 3.5 ATA 80GB 7200 RPM | PicoPSU60 | 28 | 34 |
| A Value Technologie ECM-3711 E10A10000R | Via Eden Esther 1000 Mhz 90nm | Toshiba MK8034GSX 2.5 SATA 80GB 5400 RPM 8m | SD-250 Flex ATX | 27 | 32 |
| INTEL MOTHERBOARD D201GLY (B) | Intel Celeron 215 Yonah 1330 Mhz / 65 nm | Samsung SP0842N 3.5 ATA 80GB 7200 RPM | PicoPSU60 | 29.5 | 36 |
| VIA MOTHERBOARD EPIA-LN10000EG | VIA C7 Esther 1000 Mhz 90 nm | Toshiba MK8034GSX 2.5 SATA 80GB 5400 RPM 8m | PicoPSU60 | 18.5 | 25 |
| Ebox 4300 | VIA Eden ULV 500 Mhz | Hitachi 2.5” SATA 80GB | own external PSU | 8.5 | 10 |
| Brandless | VIA C7 Esther 1.5 Ghz 90 nm | Toshiba MK8034GSX 2.5 SATA 80GB 5400 RPM 8m | PicoPSU60 | 18 | 27 |
The outcome is not very surprising: The VIA C3 is obviously the lowest power consuming, and the Intel boards consume the most. The Intel Atom board is only slightly less power hungry than the D201GLY. This comes as a suprise, since the Atom platform is launched as being low power. The reason for the relative high power consumption of the Atom board is because the Intel 945 chipset uses a lot of power. That is also the reason that the chipset has a fan, and the CPU only has a heatsink.
CPU benchmark tests
The results of the ten tests we have done are presented below. The lowest scores are presented in italics, while the highest scores are presented in bold letters. Since the Intel D201GLY only supports IDE, and the rest of the testing has been done with a 2,5” SATA drive (at 5400 RPM, while the IDE disk runs at 7200 RPM) an extra benchmark test has been done on the Intel D945GCLF with the IDE disk as this board is performance-wise the closest to the D201GLY.
| INTEL MOTHERBOARD D945GCLF | INTEL MOTHERBOARD D945GCLF | INTEL LAPTOP ICBOOK | A Value Technologie ECM-3711 E10A10000R | INTEL MOTHERBOARD D201GLY (B) | VIA MOTHERBOARD EPIA-LN10000EG | Ebox 4300 | Brandless | |
|---|---|---|---|---|---|---|---|---|
| CPU | Intel Atom Silverthorne 1660 Mhz 45nm | Intel Atom Silverthorne 1660 Mhz 45nm | Intel Celeron M 353 Dothan 900 Mhz / 90nm | Via Eden Esther 1000 Mhz / 90nm | Intel Celeron 215 Yonah 1330 Mhz / 65 nm | VIA C7 Esther 1000 Mhz / 90 nm | VIA Eden ULV 500 Mhz | VIA C7 Esther 1.5 Ghz 90 nm |
| HDD | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m | Samsung SP0842N 3.5” ATA 80GB 7200 RPM | Seagate ST730212DE 1.8” ATA 30 GB 3600 RPM 2m | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m | Samsung SP0842N 3.5” ATA 80GB 7200 RPM | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m | Hitachi 2.5” SATA 80GB | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m |
| RAM | Transend 512M DDR2 667 Dimm 5-5-5 | Transend 512M DDR2 667 Dimm 5-5-5 | Nanya 512M DD2 333 | Transcend 512M DDR 333 SoDimm CL 2.5 | Transend 512M DDR2 667 Dimm 5-5-5 | Transend 512M DDR2 667 Dimm 5-5-5 | Transend 512M DDR2 667 Dimm 5-5-5 | |
| Power Supply | PicoPSU60 | PicoPSU60 | Internal on board | SD-250 Flex ATX | PicoPSU60 | PicoPSU60 | own external PSU | PicoPSU60 |
| Mp3 Compression (minutes) | 14:24 | 14:27 | 13:02 | 27:54 | 7:18 | 28:00 | 56:20 | 19:12 |
| Mp3 Decoding (minutes) | 3:22 | 3:25 | 4:51 | 6:50 | 3:08 | 6:55 | 13:48 | 04:34 |
| SuperPI 1M (minutes) | 1:33 | 1:49 | 4:42 | 7:59 | 1:12 | 8:00 | 15:59 | 05:48 |
| Blender (minutes) | 10:54 | 10:52 | 9:23 | 21:17 | 5:16 | 21:42 | 42:30 | 14:16 |
| 7ZIP Benchmark (MIPS) | 668 | 660 | 594 | 422 | 973 | 433 | 229 | 591 |
| 7ZIP Compression kernel (minutes) | 3.22 | 3.54 | 17:02 | 7.33 | 3:56 | 7:07 | 12:56 | 4.27 |
| Rar Benchmark (kb/s) | 352 | 359 | 190 | 108 | 254 | 110 | 73 | 125 |
| CPUMark 99 v1.0 | 112 | 112 | 44.7 | 74.7 | 143 | 74.7 | 38.9 | 105 |
| BOINC Whetstone (MIPS) | 701 | 697 | 817 | 264 | 1258 | 263 | 131 | 394 |
| BOINC Dhrystone (MIPS) | 1834 | 1835 | 1606 | 1014 | 2627 | 1008 | 496 | 1512 |
Some very interesting conclusion can be drawn from these results.
First of all, the difference between the tests on the Intel D945GCLF with a 2,5” SATA disk at 5400 RPM and the 7200 RPM IDE disk are negligible. This makes the systems with either disk comparable The big winner here is the Intel D201GLY. It has the best score on 7 out of the 10 tests. Second best is the Intel D945GCLF with the new Atom CPU on it. One note here however: The Atom CPU has hyperthreading capabilities, and not all the tests are hyperthreading aware. 7zip and WinRAR are optimised for hyperthreading, and that is reflected in the results. It became even more apparent when we did the Blender benchmark again. Blender allows the user to manually set the numbers of threads which are used. The result was 7:03 minutes! An obvious winner. But many desktop applications are NOT hyperthreading aware, so differences in performance are not noticed when a hyperthreading capable cpu is used in office or school environments. So, the best performing CPU would technically be the Atom CPU, but realistically, the Intel Celeron CPU is the winner (albeit with a slight margin). The worst performing CPU is the VIA Eden 500 Mhz. Of course, this is caused by its' low clockspeed. The VIA Esther CPU's perform clearly worse than the Intel Atom or Intel Celeron CPU. This makes Intel the performance winner.
Usability tests
In the table below are the results shown of our usability tests. These tests have subjective outcomes, and as such, the conclusions could be interpreted differently!
| INTEL MOTHERBOARD D945GCLF | INTEL MOTHERBOARD D945GCLF | INTEL LAPTOP ICBOOK | A Value Technologie ECM-3711 E10A10000R | INTEL MOTHERBOARD D201GLY (B) | VIA MOTHERBOARD EPIA-LN10000EG | Ebox 4300 | Brandless | |
|---|---|---|---|---|---|---|---|---|
| CPU | Intel Atom Silverthorne 1660 Mhz 45nm | Intel Atom Silverthorne 1660 Mhz 45nm | Intel Celeron M 353 Dothan 900 Mhz / 90nm | Via Eden Esther 1000 Mhz / 90nm | Intel Celeron 215 Yonah 1330 Mhz / 65 nm | VIA C7 Esther 1000 Mhz / 90 nm | VIA Eden ULV 500 Mhz | VIA C7 Esther 1.5 Ghz 90 nm |
| HDD | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m | Samsung SP0842N 3.5” ATA 80GB 7200 RPM | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m | Samsung SP0842N 3.5” ATA 80GB 7200 RPM | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m | Hitachi 2.5” SATA 80GB | Toshiba MK8034GSX 2.5” SATA 80GB 5400 RPM 8m | |
| RAM | Transend 512M DDR2 667 Dimm 5-5-5 | Transend 512M DDR2 667 Dimm 5-5-5 | Transcend 512M DDR 333 SoDimm CL 2.5 | Transend 512M DDR2 667 Dimm 5-5-5 | Transend 512M DDR2 667 Dimm 5-5-5 | Transend 512M DDR2 667 Dimm 5-5-5 | ||
| Open OO document (s) | 13.3 | 12.7 | 26.4 | 22 | 9.2 | 18.3 | 38.8 | 16.8 |
| HD Video playback | Perfect, 30-40% CPU | Perfect, 30-40% CPU | Not working | Not working | works at 50% cpu | Not working | Not working | Very sloppy but showing something |
| Google Earth | Works, at 10-20 % CPU | Works at 10-20 % CPU | works at 40-60% CPU | 60-80 % CPU Sluggish, but works | works at 50% cpu | works, 60-70% cpu usage | Working, but high cpu (60-80 %) Not very fluent. But works |
The OpenOffice test underlines the conclusions of the CPU benchmarking test: The Intel D201GLY wins again. The Ebox is the slowest (as it only has a 500 Mhz. Eden CPU). The Atom is second again. The HD video playback benchmarks shows some very interesting results. The clear winner is the D945GCLF board. The Intel 945 chipset clearly shows some performance gains here! The only CPU other that the Celeron and Atom capable of playing back an HD movie is the VIA 1.5 GHz CPU with the VIA CN700 chipset. However, the image is sloppy, so we wouldn't recommend for HD use. The Google Earth test shows that all hardware is capable of using the software, again with the faster machines it works smoother.
Powersupply tests
The power supply test was quite straightforward and the results are presented in the table below:
| Power Supply used | A002 | A003 | A004 | F001 | F002 | F003 | C001 | C002 | Morex | Pico PSU |
|---|---|---|---|---|---|---|---|---|---|---|
| CPU IDLE | 38 W | 35 W | 34.5 W | 37 W | 36 W | 41 W | 31.5 W | 37.5 W | 30.5 | 29 W |
| CPU 100% | 44.5 W | 41 W | 40.5W | 43 W | 43 W | 48 W | 38 W | 44 W | 37.5 W | 35.5 W |
| Remarks | Fluctuating | Very Noisy | Very stable | Old second hand | Worst | Custom Fanless No 4pins | Custom Fanless No 4pins | BEST Fanless | No 1 |
These were the powersupplies we have tested:
| Code | Brand and type | Power Output | Form Factor | Remark |
|---|---|---|---|---|
| A002 | Brandless | Unknown | ATX | Very cheap off the shelf power supply |
| A003 | FSP Group FSP250-50GLV | 250 | Custom | Big powersupply, custom form factor |
| A004 | Delta electronics DPS-88AB | 90 W | ATX | Old secondhand PSU, probably from a Compaq PC |
| F001 | Channel Well Technology PSF200F-39 | 200 W | Flex-ATX | Simple powersupply, small |
| F002 | R-Senda SD-250PSU | 200W | Flex-ATX | Simple powersupply, small |
| F003 | ElanVital EVN 1216 | 121W | Flex-ATX | Longer than F001 and F002 |
| C001 | Unknown, B1-006 | unknown | Custom | Custom built casing around a custom open powersupply |
| C002 | Unknown, NS-003-2 | 60 W | Custom | Custom built casing around a custom open powersupply |
| C003 | Morex PDB060R | 60 W | Open powersupply | Open powersupply DC to DC with external 12 V |
| C004 | Pico powersupply 60 | 60 W | Open powersupply | Tiny DC to DC PSU mounted on 20 pins Molex |
The fanless powersupplies have the best efficiency. The best powersupply is the Pico PSU. This is also the most expensive one.
Conclusions
Selecting hardware is not a straightforward task. There are many factors which have to be taken into account, such as purchase costs, running costs, performance, usability and availability Giving a straightforward conclusion is not possible, since for every user the factors listed above have another significance. In this conclusion, each of the above factors will be analysed.
Purchase costs
The purchase costs of hardware are related to the scale of deployment. Buying 30 PC's or 3000 PC's can make a huge difference. Sometimes higher costs mean lower powerconsumption. The Pico powersupply, which costs around $60,- is a perfect example of this. When talking about motherboards, more costs can mean better support, or better warranty. It does not always imply better performance. In fact, our cheapest board (the Intel D201GLY) has the highest performance! But our most expensive board, the VIA 1000 Mhz, is fanless, which can have considerable advantages in rural classrooms. Purchase costs have to be carefully measured against the capabilities and other benefits.
Running costs
The only running costs this research has investigated are the electricity costs. Maintenance costs have not been taken into account yet. This researched only looked into low power computers and hardware combinations, so even the biggest electricity consumer is nothing compared to what is on normal office desks. To give an example: The computer under my desk, a Pentium 4 3.2 Ghz uses 80 Watts when idle, as compared to around 30 Watts as highest for our measurements! The hardware has been put in three different qualifications: High consumption, medium consumption and low consumption. Low consumption means 100 % cpu usage below 15 Watts, medium consumption means 100 % cpu usage between 15 and 25 Watts, and high consumption means a 100 % cpu utilisation above 25 Watts.
| Low Consumption | Medium Consumption | High Consumption |
|---|---|---|
| Ebox 4300 | VIA EPIA-LN10000EG, Brandless VIA 1,5 Ghz, Intel D945GCLF | A Value Technologie ECM-3711 E10A10000R, Intel D201GLY |
Some remarks are in place here though. We need to do extra measurements!! HOWEVER, CONCLUSION IS VALID
The conclusion is here that the Intels use the most, VIA CPU's 1 Ghz and 1,5 Ghz are somewhere in the middle, and the 500 Mhz CPU's are using the least Watts. This is in line with their performance, as shown in the performance paragraph.
When selecting hardware, getting a fanless (or “open”) powersupply will enhance the efficiency of that powersupply. A 2,5” harddisk can also significantly reduce the amount of power used.
Performance
The performance results are in line with our expectations. The Intel CPU's have the best performance, the VIA 1,0 and 1,5 Ghz are somewhere in the middle, and the 500 Mhz Eden CPU is on the lower end. This is in line with the power consumption, which makes a lot of sense. What is surprising though, is the better performance of the Intel D201GLY with it's Celeron CPU: Intel's marketing machine boasts the performance of their new Atom CPU, but its' performance is less than the Celeron CPU! Of course, the hyperthreading capabilities have not been used in most of our tests, and it performs better with software optimised to take advantage of hyperthreading.
Usability
Usability is a tricky concept. All the hardware we tested was usable. The fact that even an application like Google Earth was running on all machines shows that they all could theoretically be used in classrooms. The current Cambodian curriculum consists of mainly office applications. Although it takes more than 30 seconds to open an OpenOffice presentation on the Ebox with it's 500 Mhz CPU, that is still acceptable, especially in a school environment. However, not all applications run smoothly on the slowest machines, and if you want to have a better experience, and be able to run more demanding software, it is better to go for at least a C7 Via Eden CPU. On the fastest end are the Intel CPU's.
Availability
Availability of hardware is of course a matter of scale. Currently, it is very difficult to obtain low cost hardware in computer shops in Phnom Penh. The only motherboard available is the 1,5 Ghz VIA brandless board. Intel also has an office in Phnom Penh, making it easier to obtain Intel boards. Small scale deployments will be difficult when using local shops. However, large scale deployments can be a lot easier, since the buyer can contact manufacturers directly. Since all computer manufacturers are located in Asia, getting hardware for large scale deployments will be relatively easy. Another aspect on availability is the fact that new hardware is introduced often, which makes it difficult to give a prediction on what is available in future. One example is the VIA Nano CPU, which is promising, but will not see it's first boards for the coming two or three months.
Overall conclusion
There are three different scenario's thinkable with the outcomes of this research:
- Very low power consumption, not so great performance: The Ebox 4300. It consumes only 11 Watts at 100% CPU, making it an ideal candidate. Disadvantage of this computer is its' costs: $300,-
- Medium power consumption, medium performance: Boards equipped with a VIA Eden C7 CPU (more than 1 Ghz). Power consumption is around 20 Watts with these boards. The price is slightly higher as the Intel boards
- High power consumption, high performance: The Intel boards (with Celeron or Atom CPU) fall into this category. They are cheap as well, with a price of board and CPU somewhere around $75,-
Add a 2,5” harddrive and an open powersupply to it to keep the power consumption at a minimum.
Discussion
This research has been carried out to enhance the level of knowledge on low power and low cost computer hardware for education. Hardware though, is only a very small part of the overall picture. In fact, the hardware decision should be made at the very last moment, after several decisions have been taken. There must be a plan on the kind of software which is going to be used on the computers, the operating systems (and whether techniques like terminal servers are used), maintenance plans, and so forth. Only if all these prerequisites are in place, a suitable hardware solution can be implemented. To give an example: If there is no organisation available to do the software maintenance, a probable software solution would not include server based computing, as some knowledge on server based computing should be available. This means that the desktop computers will need more memory and performance than when thin clients are used.