Cable connection concept for remote embedded modular computers

For three decades, industrial PCs have used two types of internal architecture: motherboards and passive backplanes. A new PCI Express over cable concept will improve the capabilities of the next computers on smaller foot prints by ten times, according to the manufacturer.

Figure 1. Concept of myOPALE


By Frederic Aupetit, Ecrin Systems                         Download PDF version of this article


For three decades, industrial PCs have used two types of internal architecture, motherboards and passive backplanes: ATX motherboards with slots for ISA, PCI and PCIe I/O extensions connected perpendicularly to the motherboard, or smaller form factors like EBX/miniITX variants for 1U chassis for up to 2x I/O cards in parallel to the motherboard, and since 1994, PICMG 1.0 and 1.3 passive backplanes, where a single board computer and its I/O cards are connected vertically to offer more I/O sites and better MTTR for industrial and test bench systems.

The major evolution during the last 25 years has essentially concerned only the size of the housing, which has shrunk from standard 4U/2U 19’’ rackmount to Box PCs, so-called fanless IPCs. In all cases, the SBC and its I/O cards have remained physically and mechanically connected through Peripheral Component Interconnect, nowadays PCI Express, a local bus standard developed by Intel Corporation in 2004 and now promoted by PCI-SIG. The PCI Special Interest Group is the consortium responsible for specifying the PCI, PCI-X and PCIe computer buses since 1992. This PC backplane interface standard is not optimal in many cases. In 1U 19’’ chassis, only two I/O cards can be mounted, and mechanical fixing and cards exchange are complex in 1U and 2U chassis due to riser or butterfly backplane interconnects. Reliability of the contacts is not optimal and customization NRC will be necessary in most appliances. Furthermore, connectors of all I/O boards and SBCs are located at the same side of the chassis, usually at the rear panel. If specific connectors are needed (BNC, XLR, SMA, RJFTV, 38999…), all I/O cards and computer boards have to be moved, as an entire block, inside the housing, and chassis depth will therefore increase drastically. There is also no universal method to dissipate waste heat from hot spots, and in most of the cases, chassis customization will generate NRC and extra cost for recurrent. Customized appliances will usually require a complete mechanical and electronic redesign.

Figure 2. Configuration based on one myOPALE-CPU driving three myOPALE-IO, allowing to integrate up to five I/O cards in 1U/19’’ rackmount. Common variants: 2 systems in one, I/O connectors on front or rear panel.

Ecrin’s myOPALE concept is based on four major principles. It breaks the mechanical link between the computer mainboard and its I/O cards thanks to PCI Express over cable interconnection. It uses building blocks in a standard form factor. The re-use of universal deployed interconnect standards from SNIA (Storage Networking Industry Association) that encompass cables, connectors, form factor sizes and housing dimensions, transceiver interfaces and related technologies is possible. These specifications enable multi-source products and solutions. And finally, it includes the cooling system as a building block.

PCI Express was introduced by Intel in 2004 as the new Peripheral Component Interconnect serial bus. Today, PCIe is very popular as the PC backplane interface standard, but it is still less known as a high-speed cabling interface. The serial technology and embedded clocking within each differential signal pair allow PCIe protocol to be used at full speed across a motherboard or over a cable with the benefits of high performance, low power and reduced costs. The cabled version of PCIe features the same high-speed differential line pairs as one that transfers data on PCBs, as well as a number of additional signals – known as sideband signals. One PCIe lane consists of two pairs of cables individually shielded for EMI protection – one transmit-pair and one receive-pair. Sideband signals provide additional functionalities, but are not directly involved in the PCIe data transfer.

Figure 3. PCIe over cable miniSAS-HD connector allows to move back I/O cards in myOPALE-IO to provide custom connectors independently from myOPALE-CPU, on front or rear panel.

The myOPALE concept integrates most advantages of PCI Express over cable inside the rack. In this concept the PCIe backplane bus is conceptually stretched to operate over a cable from CPUs to secondary I/O backplanes, physically located anywhere in the chassis. Thus it offers many advantages in a small footprint 1U 19’’ rackmount, but also very interesting capabilities for other integration formats beyond the limits of the previous IPC generation.

The choice of the Mini-SAS HD (SFF-8643) connector for PCIe over cable was also electrically the best solution thanks to its multi-source and price/quality ratio. It is COTS ready and able to use cables from 30cm to 1m and lockable connectors to protect against shock and vibration in harsh environments. The high bandwidth of 12Gbps for PCI Express Gen3 protocol and 8 differential links for 4X lanes PCIe Gen3 enable high data throughput. Eight sideband signals for the control plane between myOPALE-CPU and myOPALE-IO building blocks are available. Compatibility with new NVM Express storage media and networks, availability of standard cable from Mini-SAS HD (SFF-8643) to U.2 (SFF-8639) is ensured. Availability of M.2 and PCIe 4X form factor boards to Mini-SAS HD will allow to integrate myOPALE-IO modules into standard PCs.

Figure 4. Blade with expansion slot demonstrates the capability to integrate 6- in-1 system in 4U/19’’ rackmount. Each blade can drive up to two I/O cards.

Mechanically Ecrin has adopted the SNIA SFF-8500 specification that defines the configuration characteristics associated with 5.25" drives bay for the following reasons: ideal format for 1U/19’’ rack mount (41.3mm x 146.1mm), well adapted to full-height PCIe I/O cards, compliant form factor with custom COM Express carrier boards, easy integration into rack, desktop or tower chassis. The set of specifications includes external dimensions, connectors, connector placement, mounting holes and interface pinouts to assist manufacturers for system integration.

The CPU module incorporates all features of embedded computers into an SFF 5.25’’ site with 200mm depth only. These are: 6/7th Gen Intel Core, Intel Xeon E3-1500 processors, up to 32GB Dual Channel DDR4, with ECC support for Intel Xeon E3-1500 SKU, legacy I/O on front panel; DisplayPort (x2), GbE, USB 3.0 (x4), legacy I/O on rear panel; 2x SATA 6.0Gb/s ; 3x USB 2.0 (Micro-Fit 24-pin connector), internal bay for 2.5" SSD/HDD, SATA 6.0Gb/s, 24x PCIe Gen3 lanes through six Mini-SAS HD connectors (4 PCIe lanes per Mini-SAS HD connector), and 12VDC power supply (+5Vstb for ATX mode).

The design is based on COM Express Type 6 that integrates embedded low power SKUs with 10 years life support. In Skylake and Kaby Lake versions, Intel Core i7 or Xeon E3-1500 CPUs with Chipset platform are selected, which directly drive 24 PCIe Gen3 lanes as their expansion bus. They can be grouped by 8/8/4/4 or 8/4/4/4/4 which allows to drive up to five I/O cards per processor. PCIe cable adapters on the carrier card is quite simple by routing to the connector, and provides some signal conditioning to guarantee the signal integrity is met at the other ends of the cable. Because these adapters are simple, they are inexpensive. Because they don’t convert the PCIe protocol into anything else, they provide higher performance and don’t require any software drivers (as do such others as thunderbolt, InfiniBand, firewire, USB, Fiber channel…). Throughput and latency, offered by PCIe over cable in myOPALE system, are the best of any other protocol or I/O adapter.

Power supply may be used in AT or ATX-mode. In AT-mode, 12V input is fine. +5VStb is generated internally to support Wake-on-LAN function and AMT Remote Power-on. In ATX-mode, +5VStb signal input is provided via a 6-pin power connector to myOPALE-CPU which monitors PS-ON to drive the power supply unit. The cooling system is based on an aluminum mono-block composed of two areas: one conduction-cooled cold plate that takes away heat from its CPU hot spot up to fins cooled by a forced air-flow system (2x 40mm fans in push-pull mode). Temperature and fan speed are monitored by the embedded CPU.

Figure 5. Just by integrating one COTS PCIe or M.2 adaptor to miniSAS-HD card, you can add myOPALE-IO on the front panel of your PC for audio, broadcast, communication extensions.

Sideband control signals selected from Mini-SAS HD cable allow myOPALE-CPU to manage and monitor each myOPALE-IO without extra cabling. Power and Reset buttons, HDD activity and Default LEDs are available on the front panel and simultaneously on a rear Micro-Fit 24-pin connector for remote control.  The myOPALE-IO module can integrate up to two full-height I/O cards in a standard 5.25’’ drive bay with 200mm depth. Half-length I/O cards will be completely enclosed in the housing, while full-length cards can protrude from the back without any inconvenience. A retaining bracket system for card lock will protect low profile and full-height I/O modules against shocks and vibrations stress.

Two versions of myOPALE-IO exist with different passive backplanes: two PCIe Gen3 4X I/O sites and one PCIe Gen3 8X I/O site. For both versions, PCIe connectors are mechanically in PCIe 16x format to accept all types of I/O boards in PCI Express (x1, x4, x8 and x16) format. The myOPALE-IO backplane converts Mini-SAS HD connectors to standard PCIe direct linear connectors, ready to accept any type of COTS or Custom PCIe I/O cards. Ecrin Systems integrates also two other functions: a DC/DC converter from 12VDC to 3.3VDC and an automatic 2-fan control system from a Look Up table. Sideband control signals from Mini-SAS HD connector allow the control of the power supply, and monitor local temperature and fan speeds.

The ability to run PCIe over cable at full performance with software transparency opens up a range of new applications for CPU and I/O system re-positioning in a rack. myOPALE extends the PCIe bus structure to dedicated PCIe I/O hardware. PCIe over cable provides a simple method for extending applications that need more I/O boards than could be fitted in a standard Industrial PC based on backplanes. Designing compatible end-points is straightforward because the PCIe interface is available as a gate array library.

Having backplane performance available over a cable expands the myOPALE usage model to encompass many high-end mono- and multi-chassis applications including more I/O expansion with different system integration capabilities, disk array subsystems based on NVMe interface, high speed video and audio editing equipment, quick trading with many pairs of CPU/FPGA in one system, medical imaging systems, etc.


Related


ADLINK and NVIDIA: AI at the Edge

ADLINK and NVIDIA are working together now to deliver Edge Computing products which include AI and deep learning technologies. At Embedded World, where ADLINK demoed autonomous mobile robotics and oth...

Embedded Computing for Extreme Environments

Designing embedded computer platforms that can cope with extremes in temperature, vibration and humidity demands a focused approach to quality. Delivering truly rugged solutions requires a focused str...

COM Express is heading towards Server-on-Module

With the new revision 3.0 of the most successful Computer-on-Module standard a new pinout Type is added to extend the reach of COM Express to server Type applications. As explained in this White P...

Robust IoT Server Solution for Offshore Drilling

Not many environments are tougher than an offshore drilling platform. Learn how MEN Mikro’s robust rack housing designs and boards meet the industry’s stringent requirements for protec...

Challenges for Safety-Critical AFDX Applications

A growing number of safety-critical avionic solutions are using the “Avionic Full Duplex Switched Ethernet” (AFDX), designated ARINC 664P7, specification for a deterministic aircraft d...

Making interactive Signage more effective

Interactive signage makes advertising more engaging. It invites customers to drive their own experience with a store’s products and brand. However, retailers will find they can get more valu...


Defining IoT and Industry 4.0 with embedded systems

Embedded systems play a vital role in both characterizing and developing the Internet of Things as well as in creating new processes in automation. They address several requirements of IoT solutions a...

 

nVent Schroff at Embedded World 2019

The theme of the nVent Schroff booth at Embedded World 2019 was “Experience Expertise – Modularity, Performance, Protection and Design”. Join us as our experts give an overview of th...


Garz & Fricke Interview at Embedded World 2019 with Dr. Arne Dethlefs: We are strengthening our presence in North America

Through its US subsidiary, located in Minnesota, Garz & Fricke is providing support for its growing HMI and Panel-PC business in the USA and Canada while also strengthening its presence in North A...


SECO's innovations at embedded world 2019

In a much larger stand than in previous years, at embedded world 2019 SECO showcases its wide range of solutions and services for the industrial domain and IoT. Among the main innovations, in this vid...


Design and Manufacturing Services at Portwell

Since about two years Portwell is part of the Posiflex Group. Together with KIOSK, the US market leader in KIOSK systems, the Posiflex Group is a strong player in the Retail, KIOSK and Embedded market...


Arrow capabilities in design support

Florian Freund, Engineering Director DACH at Arrow Electronics talks us through Arrow’s transformation from distributor to Technology Platform Provider and how Arrow is positioned in both, Custo...


Arm launches PSA Certified to improve trust in IoT security

Arm’s Platform Security Architecture (PSA) has taken a step forward with the launch of PSA Certified, a scheme where independent labs will verify that IoT devices have the right level of securit...


DIN-Rail Embedded Computers from MEN Mikro

The DIN-Rail system from MEN is a selection of individual pre-fabricated modules that can variably combine features as required for a range of embedded Rail Onboard and Rail Wayside applications. The ...


Embedded Graphics Accelerates AI at the Edge

The adoption of graphics in embedded and AI applications are growing exponentially. While graphics are widely available in the market, product lifecycle, custom change and harsh operating environments...


ADLINK Optimizes Edge AI with Heterogeneous Computing Platforms

With increasing complexity of applications, no single type of computing core can fulfill all application requirements. To optimize AI performance at the edge, an optimized solution will often employ a...


Synchronized Debugging of Multi-Target Systems

The UDE Multi-Target Debug Solution from PLS provides synchronous debugging of AURIX multi-chip systems. A special adapter handles the communication between two MCUs and the UAD3+ access device and pr...


Smart Panel Fulfills Application Needs with Flexibility

To meet all requirement of vertical applications, ADLINK’s Smart Panel is engineered for flexible configuration and expansion to reduce R&D time and effort and accelerate time to market. The...


Artificial Intelligence

Morten Kreiberg-Block, Director of Supplier & Technology Marketing EMEA at Arrow Electronics talks about the power of AI and enabling platforms. Morten shares some examples of traditional designin...


Arrow’s IoT Technology Platform – Sensor to Sunset

Andrew Bickley, Director IoT EMEA at Arrow Electronics talks about challenges in the IoT world and how Arrow is facing those through the Sensor to Sunset approach. Over the lifecycle of the connected ...


AAEON – Spreading Intelligence in the connected World

AAEON is moving from creating the simple hardware to creating the great solutions within Artificial Intelligence and IoT. AAEON is offering the new solutions for emerging markets, like robotics, drone...


Arrow as a Technology Provider drive Solutions selling approach

Amir Sherman, Director of Engineering Solutions & Embedded Technology at Arrow Electronics talks about the transition started couple of years ago from a components’ distributor to Technology...


Riding the Technology wave

David Spragg, VP, Engineering – EMEA at Arrow Electronics talks about improvements in software and hardware enabling to utilize the AI capabilities. David shares how Arrow with its solutions is ...


ASIC Design Services explains their Core Deep Learning framework for FPGA design

In this video Robert Green from ASIC Design Services describes their Core Deep Learning (CDL) framework for FPGA design at electronica 2018 in Munich, Germany. CDL technology accelerates Convolutional...


Microchip explains some of their latest smart home and facility solutions

In this video Caesar from Microchip talks about the company's latest smart home solutions at electronica 2018 in Munich, Germany. One demonstrator shown highlights the convenience and functionalit...


Infineon explains their latest CoolGaN devices at electronica 2018

In this video Infineon talks about their new CoolGaN 600 V e-mode HEMTs and GaN EiceDRIVER ICs, offering a higher power density enabling smaller and lighter designs, lower overall system cost. The nor...


Analog Devices demonstrates a novel high-efficiency charge pump with hybrid tech

In this video Frederik Dostal from Analog Devices explains a very high-efficiency charge-pump demonstration at their boot at electronica 2018 in Munich, Germany. Able to achieve an operating efficienc...