Demartek Lab Validation Testing
- Testing Services and Infrastructure
- ISO 17025 Accreditation
- SNIA Emerald™ Recognized Tester
- EPA ENERGY STAR® Data Center Storage Testing
- Cross-media Content Delivery: Videos, Infographics, etc.
- Social Media
- Power Capabilities
- Demartek Web Browser Test Page
- Contact Demartek
To be notified when we post new deployment guides, evaluation reports and commentaries, sign-up for our free monthly newsletter, Demartek Lab Notes. We do not give out, rent or sell our email list.
Testing Services and Infrastructure
Demartek provides independent, real-world, hands-on research & analysis by focusing on industry analysis and third-party lab validation testing of data center computer equipment such as servers, networking and storage systems. Demartek has experienced I.T. professionals on staff and has invested in its own lab facilities including servers, networking, storage infrastructure and more. We also work with new technologies just coming to market. We have commented or written about some of these new technologies on our news page or in the Demartek Video Library. Specific technology test results are available on our FC Zone, iSCSI Zone, NVMe Zone and SSD Zone pages.
Due to the variety of interface types used for storage devices, Demartek has compiled its popular Storage Interface Comparison reference page that provides technical information for many storage interfaces. This page was updated in June 2018.
Demartek performs both public and private testing of hardware and software solutions, providing objective analytical data on the performance, deployment and ease-of-use of datacenter solutions. We post results of public projects on our website. Results of private testing are not posted on our website. Demartek’s lab testing services include:
- Ease of Use Studies
- Deployment Guides and Solutions Guides
- Lab Validation Testing
- Integration testing with cloud services such as AWS and Azure
- Internet of Things (IoT) testing
- Performance Testing and Reporting
- Synthetic benchmarks using tools such as Iometer, VDbench, FIO, Diskspd, VM Fleet, etc.
- Database testing using real databases such as Oracle and Microsoft SQL Server
- Includes Oracle ORION — provided by Oracle and expressly designed for simulating Oracle database I/O workloads using the same I/O software stack as Oracle.
- Email testing such as Microsoft Jetstress and ESRP, LoadGen and our own email server message generator
- File server testing (includes SPEC SFS 2014)
- Hadoop, Ceph, OpenStack and other distributed computing and storage environments
- Yahoo Cloud Serving Benchmark (YCSB)
- Virtualization (VMware vSphere, Microsoft Hyper-V, KVM, Xen and others) including VMmark
- Virtual Desktop Infrastructure (VDI) including Login VSI
- Hyper-Converged Infrastructure (HCI)
- Web Server testing
- Pre-GA Regression and Quality Assurance (QA) Testing
- Install new firmware or software, run synthetic or real-world tests, record results, then repeat as needed
- Electrical Power Efficiency Testing
Demartek offers translations of our reports into non-English languages. View an example of one of our reports available in four other languages (scroll to the bottom of that page).
Demartek has a collection quad-processor, dual-processor and single-processor rack and blade servers, some having 60 or more cores, and up to 1.5 TB of memory in these servers, making them suitable for a wide variety of storage stress testing, virtualized server environment testing and for testing real-world applications such as Microsoft Exchange Server, SQL Server, SharePoint Server, Oracle database and more.
In September 2017, we received the first wave of servers with Intel® Xeon® Scalable (“Skylake”) processors in what are also known as “Purley” platforms, with more expected to arrive in the Demartek lab in October 2017. These servers, along with one we have from the prior generation, support NVDIMM memory technology. Also, in late 2017, we began to receive servers with the AMD EPYC™ processors. In December 2014, we added an eight-node cluster of servers to perform Hadoop and other distributed computing and storage platform testing.
The Demartek lab is equipped with Ethernet switches that have many ports of 1Gb Ethernet (1GbE), 10Gb Ethernet (10GbE), and several ports of 40Gb Ethernet (40GbE). We recently added a new 25GbE/100GbE switch that supports the new speeds of Ethernet. For 10GbE, we have both 10GBASE-R (SFP+) and 10GBASE-T (RJ45) switches and adapters. The 25GbE ports are SFP28. The 40GbE ports are QSFP+ and the 100GbE ports are QSFP28.
Demartek has appropriate copper and fiber optic cables for 1GbE, 10GbE, 25GbE, 40GbE and 100GbE. Demartek runs typical TCP/IP network and file server traffic, in addition to FCoE and iSCSI traffic. Demartek has 1GbE, 10GbE, 25GbE, 40GbE and 100GbE NICs, iSCSI offload adapters and FCoE CNAs. Some of the NICs support SR-IOV, RoCE (RDMA over Converged Ethernet) and/or iWARP.
Demartek has 32Gb, 16Gb and 8Gb Fibre Channel switches in its lab, along with 32Gb, 16Gb and 8Gb Fibre Channel HBAs and the appropriate fiber optic cables and transceivers (optics).
Demartek has 12Gb, 6Gb and 3Gb SAS HBAs and RAID controllers, including SSD caching versions. Demartek also has a SAS switch in its lab.
Demartek has a variety of direct attached storage (DAS), network attached storage (NAS) and storage area network (SAN) storage systems. The NAS and SAN storage systems connect via various speeds of Ethernet and Fibre Channel (see above). For DAS, we have a 60-drive JBOD available for testing that supports 3.5-inch (LFF) and 2.5-inch (SFF) SAS and SATA drives.
NVMe and NVMe over Fabrics
Demartek has a variety of NVMe devices (drive form factor and add-in-card form factor) that can be deployed in some of the servers. In addition, we have configured complete end-to-end NVMe over Fabrics (NVMe-oF) configurations using both RDMA (RoCE) and Fibre Channel. In our NVMe-oF testing, we have observed potential sources of bottlenecks, which we describe in our NVME over Fabrics Rules of Thumb commentary page.
Demartek has a electric power meters to measure electric power consumption of servers, network and storage equipment. For precise electrical power measurement, A/C sources are used to provide power with very tight tolerances for voltage and harmonic distortion.
We have a loading dock for receiving freight shipments.
ISO 17025:2005 Accreditation
In December 2013, Demartek was awarded International Standard ISO/IEC 17025:2005 accreditation as an electrical testing laboratory. In November 2015, and again in November 2017, Demartek’s accreditation was renewed.
ISO 17025:2005 is the international standard by which a laboratory’s commitment to quality is evaluated. Demartek achieved this accreditation by demonstrating technical competence for electrical energy efficiency testing of data center storage equipment with the operation and effectiveness of its laboratory. ISO 17025:2005 not only considers management and technical expertise, but also emphasizes continual product and process improvement.
ISO 17025:2005 accreditation is an important step in Demartek’s strategy to offer energy efficiency testing for data center storage and related data center equipment. Demartek’s strong experience with deploying and running data center storage equipment from a variety of manufacturers, combined with our interest in data center energy efficiency and power consumption puts us in the unique position of performing these energy efficiency tests in our lab in a seasoned, consistent manner.
- View the Demartek ISO 17025 certificate (PDF, 104 KB)
- View the Demartek Scope of Accreditation (PDF, 40 KB)
- Accreditation (renewal) Date: November 28, 2017
- Expiration Date: November 30, 2019
- Certificate Number: 3751.01
- Scope: ENERGY STAR Program Requirements for Data Center Storage Version 1.0, ENERGY STAR Test Method for Data Center Storage Rev. Aug-2013
- Accredited by: American Association for Laboratory Accreditation (A2LA)
SNIA Emerald Recognized Tester
Demartek is the first test lab to become an official SNIA Emerald™ Recognized Tester. Demartek has demonstrated proficiency with the SNIA Emerald test procedure, and Demartek’s processes and expertise in this area have been audited by SNIA.
The SNIA Emerald program provides storage system power usage and efficiency information to the public, as part of the Green Storage Initiative. SNIA Emerald defines a very specific test procedure to provide performance/watt and capacity/watt results for storage systems, known as the SNIA Emerald™ Power Efficiency Measurement Specification. This SNIA Emerald specification is used for the EPA ENERGY STAR® Data Center Storage program.
- View the Demartek SNIA Emerald™ Recognized Tester acknowledgement
- Recognition Date: September 30, 2014
- Expiration Date: July 31, 2018
- Scope: SNIA Emerald™ Power Efficiency Measurement Specification Version 2.0.2, taxonomy categories Online 2, 3, and 4
- SNIA Emerald™ Recognized Tester Overview
Storage product vendors can be assured that Demartek has the knowledge, experience and equipment to properly run the SNIA Emerald power efficiency tests and the EPA ENERGY STAR Data Center Storage tests. Demartek has also automated the process for collecting and reporting the test results into the SNIA Emerald Test Data Report format.
For more information about energy efficiency, SNIA Emerald, EPA ENERGY STAR Data Center Storage and Demartek’s experience running these tests, attend the Demartek presentation Storage Systems Can Now Get ENERGY STAR Labels And Why You Should Care given at the Data Storage Innovation Conference in June 2016.
Update: 10 December 2014 — SNIA launched the SNIA Emerald™ Recognized Tester Program.
EPA ENERGY STAR® Data Center Storage Testing
In December 2013 Demartek became an Environmental Protection Agency (EPA) recognized test
laboratory for the United States EPA ENERGY STAR® Data Center Storage program. To qualify,
labs must be ISO 17025 accredited (see the
ISO 17025 Accreditation section above).
The EPA has applied the basic idea of energy efficiency to entire data center storage products as part of their ENERGY STAR program. The EPA ENERGY STAR Data Center Storage program defines a very specific set of tests to be run that provide energy efficiency information for these products, which Demartek has demonstrated the ability to run. In addition, the Demartek lab meets the ENERGY STAR program requirements for supply voltage, voltage tolerance and maximum total harmonic distortion.
Demartek ENERGY STAR Testing Brochure
The EPA ENERGY STAR Data Center Storage taxonomy is consistent with the taxonomy developed by the Storage Networking Industry Association (SNIA) Green Storage Initiative as defined in the SNIA Emerald™ Power Efficiency Measurement Specification. Demartek is an official SNIA Emerald™ Recognized Tester (see above).
Demartek presented at the first SNIA Emerald Power Efficiency Class in June 2013, and at the second class held in July 2014. We are skilled at finding the “best foot forward” (optimum) configuration for storage systems under test.
Demartek ENERGY STAR Datacenter Storage Certification Process
Experienced Storage Administrators
We have several years of experience deploying and running storage systems from major storage system manufacturers including EMC, NetApp, HP, IBM, Nimbus Data and others in our lab. We frequently run end-to-end validation and performance tests, configuring these storage systems into our server and networking infrastructure, and many of the results of these tests are public and available on our news page.
We have found that most modern storage systems have power supplies that support 100-250v, and perform most efficiently at 230v or 240v. However, we can run the EPA ENERGY STAR Data Center Storage tests at 115v, 120v, 230v, 240v or any other voltage required. We use A/C sources in our lab to guarantee a tight tolerance on voltage and related parameters, as required by the EPA ENERGY STAR Data Center Storage specification.
Parallel Test Execution
We have enough server and related infrastructure to run EPA ENERGY STAR Data Center Storage tests in parallel for multiple models of storage systems, which can help accelerate achieving the ENERGY STAR label.
DSI Conference Presentation: Storage Systems Can Now Get ENERGY STAR Labels and Why You Should Care
For more information about energy efficiency, SNIA Emerald, EPA ENERGY STAR Data Center Storage and Demartek’s experience running these tests, view the Demartek presentation Storage Systems Can Now Get ENERGY STAR Labels And Why You Should Care given at the Data Storage Innovation Conference in June 2016.
To get more information about our staff who run these tests, view our About Us page.
- Organization ID: 1125540
- ENERGY STAR website: EPA-Recognized Certification Bodies (CBs) and Laboratories
Cross-media Content Delivery
Demartek produces a variety of cross-media content in multiple formats, in the form of videos, infographics and more. We produce these with our branding and can produce them with other branding.
Demartek produces highlight videos for validation tests, performance reports and deployment guides. We also produce instructional videos that show users how to use specific software and hardware solutions. We can also produce animated videos that explain various technologies.
The Demartek Video Library has several examples of our public videos.
Demartek produces infographics to help communicate the results of performance testing and other tests in a visually interesting way.
Demartek promotes its public projects and materials using a variety of social media outlets. These include Facebook, LinkedIn, Twitter and YouTube. Click any of the icons below to visit our pages.
With the move to the larger facility in January 2014, 80% of the racks in the Demartek lab run with 220v/230v/240v AC electric power, and 20% of the racks run with 110v/115v/120v. Having both voltages expands Demartek’s capabilities to test storage systems, blade servers, rack servers, networking gear and other related datacenter equipment.
This electric power upgrade complements Demartek’s existing electric power infrastructure, which includes the ability to measure power consumption for various servers, networking and storage systems while under load.
Demartek Web Browser Test Page
View your browser attributes on the Demartek Lab Browser Test page.
To discuss our services or inquire about Demartek’s lab validation and testing please contact us.
231 Violet Street
Golden, CO 80401-6722
Email: firstname.lastname@example.org (as an email spam precaution, all emails sent to this address with attachments will be automatically deleted).
Keep up to date with Demartek activities by subscribing to the Demartek RSS Feed. Many web browsers, email applications and special RSS readers can subscribe to the RSS feed.
Microsoft, SharePoint and SQL Server are registered trademarks of Microsoft Corporation.
Oracle is a registered trademark of Oracle Corporation and/or its affiliates.