Not long ago, I managed to work with servers that were new to me Supermicro remote control of which is carried out using the interface IPMI. In this article, I will try to cover the main points in setting up IPMI on Supermciro servers, show the main menu items of the IPMI interface, and also talk about additional utilities, commands and methods for monitoring a server using ipmi.

IPMI(Intelligent Platform Management Interface) is an intelligent platform management interface designed for autonomous monitoring and management of functions built directly into the hardware and firmware of server platforms. (information taken from an official source). IPMI is implemented as a separate server controller, which is independent of operating system, BIOS, CPU server and allows you to remotely manage physical equipment.

Initial setup of the IPMI console and familiarization with the interface

Setting up IPMI begins with setting the IP address of the interface, which must be specified in the BIOS. If the server is installed in an office, this may be a gray IP address, but if your equipment is located in a Data Center, then you are probably using a white static IP address.

On Supermicro servers, you can access the BIOS by pressing the “ Del” when loading the server, I will not focus on this and will immediately move on to the interface of the BIOS itself.

As you can see in the screenshot, I entered the IPMI menu item and activated the Lan configuration option for the interface (Update IPMI Lan Configuration = Yes, Configuration Address Source = Static), specified the IP address, subnet mask and default gateway.

You can apply the settings by clicking the button F4, after which the server will reboot.

If you did everything correctly, then by entering in the browser specified for the IPMI IP interface, authorization will open:

Now let's go through the main points.

When purchasing a new server, a user has already been created in IPMI ADMIN with password ADMIN, it is with this data that we log in. I always recommend creating a new user and deleting the standard one or changing its password; leaving such a login and password is extremely unsafe. You can create a new user or change passwords/privileges for current ones in the menu Configuration -> Users.

Restarting the IPMI interface can be done from the menu Maintenance -> Unit Reset.

Mounting an iso OS image for installation on a server is done in the menu Virtual Media -> CD-ROM Image.

My OS iso images are stored on a Samba server in the same subnet as the IPMI server interfaces. I specify the address of the Samba server, the path to the installation ISO image with the OS, and then mount ISO image and proceed to install the operating system.

Remote graphical Java server console ( KVM-over-IP) can be opened via Remote Control -> Console Redirection.

The console is generally convenient, but after installing the OS, I usually use ssh clients to work with the server. Sometimes there are times when this is not possible, for example, if your network does not work or has not yet been configured on the server, or there are some problems with access. That's when Remote Console comes to the rescue.

None individual settings There is no need to do this in the console itself, I just want to add that it has a built-in keyboard that can be called up from the menu Virtual Media -> Virtual Keyboard.

Advice. After working with SUpermicro servers for a long time, I discovered one unpleasant bug. After installing the Centos 7 operating system and KVM installations on it, the ability to use the Remote Console disappears. While the server is booting, the console responds and you can go to Bios or see the OS kernel loading. But as soon as the operating system boots, the video in the console disappears. Through experimentation I managed to overcome this bug. You need to add the nomodeset boot parameter to the kernel boot. To do this, after installing the OS, you need to run the command:

grubby --args "nomodeset" --update-kernel /boot/vmlinuz-`uname -r`

After this, Remote Console works fine.

Server management via the IPMICFG utility from SuperMicro

To manage servers via IPMI, SuperMicro is developing its own utility IPMICFG.

You can download the IPMICFG file using the command:

wget ftp://ftp.supermicro.com/utility/IPMICFG/IPMICFG_1.30.0_build.190710.zip

At the time of publication, the file had this name, I recommend going to the SuperMicro repository using the link ftp://ftp.supermicro.com/utility/IPMICFG/ and copy the url of the current file.

Let's unpack the downloaded file into the directory we are in:

ln -s /root/IPMI*/Linux/64bit/IPMICFG-Linux.x86_64 /usr/local/sbin/ipmicfg

Now we can run the utility using the ipmicfg command (symbolic link). Let's look at the basic capabilities of the ipmicfg utility.

If we run the command ipmicfg -help we will get a list of all possible utility parameters.

Let's look at the basic commands:

• ipmicfg -help – complete help on the utility;
• ipmicfg -m – view the current IP and mac address for IPMI;
• ipmicfg -k - view the subnet mask;
• ipmicfg -g – view the specified gateway;
• ipmicfg -fd - reset IPMI to factory settings;
• ipmicfg -user list – view created users and their privileges.

You can change the IP address, mask and gateway of the IPMI interface:

• ipmicfg -m 192.168.1.200
• ipmicfg -k 255.255.255.0
• ipmicfg -g 192.168.1.1

Create a new IPMI user and password:

ipmicfg -user add

Using the utility we do the following:

ipmicfg -user add 6 test 123456 4

Thus, we created the user test with the password 123456 and administrator privileges.

The list of IPMI users and their privileges in the system can be displayed with the commands:

• ipmicfg -user list
• ipmicfg -user help

As you can already see in the screenshot, the test user has been created.

To change (reset) the IPMI user password, use the command:

ipmicfg -user setpwd

And I’ll give a couple more examples of using this utility:

• ipmicfg -hostname - set the hostname for the ipmi interface;

Monitoring hardware on a SuperMicro server via IPMI and the IPMICFG utility

SuperMicro server monitoring via IPMI

Via IPMI, monitoring the temperature and operation of the SuperMicro server hardware is quite simple. Full information about the server hardware is contained in the System -> Hardware Information item.

Information on the state of the processor, RAM and fans, you can view it by going to the Server Health -> Sensor Readings tab.

For ease of viewing, you can change the display categories of sensors, for example, temperature:

Or voltage sensors:

Since at the moment there are no problems on our server, neither with temperature nor with voltage, all sensors are in the green zone. If the server's temperature rises or there are voltage problems, the green rectangles will turn red, which will be a signal to check your server.

Monitoring using the ipmicfg utility

Checking the status of power supplies:

# ipmicfg -pminfo

Item | Value ---- | ----- Status | (00h) Input Voltage | 217.5 V Input Current | 1.06 A Main Output Voltage | 12.28 V Main Output Current | 17.93 A Temperature 1 | 23C/73F Temperature 2 | 21C/70F Fan 1 | 2064 RPM Fan 2 | 2032 RPM Main Output Power | 220 W Input Power | 228 W PMBus Revision | 0x22 PWS Serial Number | P2K4FCH02LT0125 PWS Module Number | PWS-2K04F-1R PWS Revision | REV1.0 Current Sharing Control | PEC error Item | Value ---- | ----- Status | (00h) Input Voltage | 217.5 V Input Current | 1.09 A Main Output Voltage | 12.30 V Main Output Current | 18.09 A Temperature 1 | 24C/75F Temperature 2 | 22C/72F Fan 1 | 2064 RPM Fan 2 | 2064 RPM Main Output Power | 223 W Input Power | 234 W PMBus Revision | 0x22 PWS Serial Number | P2K4FCH02LT0126 PWS Module Number | PWS-2K04F-1R PWS Revision | REV1.0 Current Sharing Control | PEC error

You can view the processor temperature with the command:

ipmicfg -nm oemgettemp

You can also check what mode the fans are operating in and change the mode if necessary.

Checking fan status and configuration

# ipmicfg -fan

Current Fan Speed ​​Mode is [ PUE2 Optimal Mode ] Supported Fan modes: 0:Standard 1:Full 3:PUE2 Optimal 4:Heavy IO

Changing the cooler operating mode: ipmicfg -fan For example, ipmicfg -fan 3

IPMI version and firmware information:

# ipmicfg -nm deviceid

Device ID = 50h Firmware Version = 4.1.4.54 IPMI Version = 2.000000 Manufacturer ID = 57 01 00 Product ID Minor Ver = Greenlow platform Implemented DCMI version = DCMI not implemented/enabled Firmware implemented version = NM Revision 4.0 Image Flag = operational image 1 raw = 50 01 04 14 02 21 57 01 00 09 0b 04 05 40 01

And you can view all sensors with the command ipmicfg -sdr

In the output, we see that there are additional columns that display information about the lower and upper limits.

There are also quite a few utilities that can be used to monitor and automate this process, for example, with nagios. At the moment, we will not focus on this, since the purpose of the article is to tell the main points in working with IPMI. If you are interested in the topic of monitoring, you can leave your wishes and perhaps in the future we will cover this topic. I hope you find this article useful!

All servers we offer for rent are equipped with an IPMI (Intelligent Platform Management Interface) controller, which allows you to turn on, turn off, remote connection(KVM) with the ability to mount ISO images, as well as providing access to information about the current state of the server.

Using IPMI, after the server is issued, you will be able to install the operating system and initial server configuration. Since the IPMI controller is connected separate cable and has its own IP address, even if you lose access to the OS, you can always manage the server remotely without the need for direct physical access.

How to install the OS?

To install the operating system, you will need to connect to the IPMI server in one of the ways convenient for you: through the Web interface or using the IPMIView program. The article will describe both options, but we recommend using the second method.

Web interface

To connect via the web interface, you must address bar enter your IPMI address in your browser and log in. You can find the address and details for authorization in the letter with access to the server or in your personal account. Next, you need to go to the Remote Control -> Console Redirection tab and click the Launch Console button.

In the Device 1 section, select ISO File in the Logical Drive Type drop-down list and specify the path to the image on your disk using the Open Image button, then connect the image with the Plug In button.

After connecting the image, reboot your server to Power section Control ->

Some servers allow you to connect up to three devices using the Device 2 or Device 3 tabs in the Virtual Media -> Virtual Storage section. This may be useful if you need to install additional drivers during installation.

If you plan to install Windows OS on the server, the key combination Ctrl+Alt+Del can be passed in the Macro section - Macro.

Instructions for working with the web interface in older versions of IPMI firmware

IPMIView

To use the Supermicro IPMIView program, you need to download it from the official website, indicating your data, or directly from the ftp server: https://www.supermicro.com/wftp/utility/IPMIView/

After installing and running the program, you need to add your server in the File - New - System section.

For System Name, enter the name of your server, and in the IP address column, enter the IPMI address, which you can find in the letter with access to the server or in your personal account. Make sure there are no spaces at the end of the line in the address column and click OK.

In the list on the left, double-click on the name of the added server, after which you will see an authorization window. Fill it out using the details from the letter or personal account and click Login. If the connection is successful, you will see Connected, and additional tabs for managing the server will appear at the very bottom of the window.

To remotely manage the server, go to the KVM Console section and click the Launch KVM Console button.

Further actions are similar to working through

Using the IPMIView program, you can also reboot, enable or disable your server in the IPMI Device tab.

Introduction

Most Firstdedic servers are equipped with an IPMI module, but many users do not pay attention to this option.

IPMI is an acronym that stands for Intelligent Platform Management Interface and is translated into Russian as “intelligent platform management interface.”

What does it represent this device. This is a module that is located directly inside the server and an additional Ethernet connector is accessible to the outside.

In case of loss of control over the server, it is possible to go to the specified address and, after logging in, perform actions to resolve problems or obtain information about the problem that has arisen.

Basically, this module is used to monitor and manage some of the functions built into the server hardware, such as: monitoring temperature sensors, voltage sensors, power supply status, fan speed, logging, connecting images, etc. Please note that these features are available regardless of processor, operating system, or BIOS. Management is available even when the server is turned off.

Unfortunately, it is currently not possible to automate the provision of access to IPMI, so access can be obtained upon request to technical support.

Upon request, an IP address is provided where the interface is located, as well as authorization data. Access is not full, limited account Operator level.

IPMI can be accessed either through a browser or using the IPMIView application. In the first case, you will need pre-installed Java and a browser plug-in, in the second - Windows or MacOS, or pre-installed Java for the multi-platform version of IPMI View.

Access via browser

After authorization, the main page opens where you can access IP-KVM (a kind of virtual monitor that transmits a video image from the server to the connected client. It can be very useful if there is an error in setting up the network, installing the OS, or when blocking IP addresses on data center level), as well as see the current state of the server, turn on, turn off and hardware reboot the server (the Power On, Power Down and Reset buttons, respectively, in the Power Control via IPMI area).

Clicking the “Refresh Preview Image” button will refresh the preview of the virtual monitor. And when you click on the black screen itself, the IP-KVM JAVA client will open and you will have access to the interface of your operating system directly using the keyboard and mouse. But for it to work you will need JAVA installed and a browser plugin

In the Server Health tab of the main menu you can view the server status, get information about fan speed, temperature and voltage

Access via desktop application

In addition to the browser version, there is also a desktop version - IPMI View, which exists in versions for Windows, MacOS and Java. The latter is multi-platform.

All latest versions IPMI View, as well as documentation, are available on the manufacturer’s official ftp server - ftp://ftp.supermicro.com/utility/IPMIView/.

Unlike the browser version, which is downloaded and launched only after use, IPMI View is installed on a PC and, when working, simply connects to the required server.

Initially, you need to add all your servers to the application settings using the “Add a new system” button (File → New → System)

Where in the IPMI address field: you need to add the IP that you received when requesting access to IPMI from technical support.

To connect to an IPMI interface, after adding it to the IPMI Domain, simply double-click on the saved system.

After clicking on the “Login” button and successful authorization, the login window to the platform management interface will change slightly: Information about the version of the IPMI used will appear, and at the very bottom of the tab with available operations.

When you go to some tabs, you will notice how the application requests information from IPMI and displays it in a more accessible form.

For example, the Sensors tab will display data in graphical form, which is somewhat more visual than just numbers, as in the browser version.

The IPM Device tab will provide access to obtaining information about the server state and managing it: turning off, turning on, rebooting and resetting (Power Down, Power Up, Power Cycle, Reset, respectively).

To close the current session and disconnect from IPMI, select the menu item Session → Close .

To help network administrators maximize time trouble-free operation servers, there are many technologies and products. Therefore, it was necessary that management standards be the same for everyone. Today, the IPMI (Intelligent Platform Management Interface) standard is one of the most important open standards and is present on all Supermicro platforms.

Most Supermicro motherboards contain a special slot that supports IPMI 2.0 cards (IPMI over LAN). IPMI technology makes it possible to remotely manage and restore a server regardless of its status and condition. Communication with the remote management console is provided using the built-in network controller, using additional bandwidth. This hardware solution, independent of the operating system. IPMI 2.0 is a fast and inexpensive way remote control, monitoring, diagnostics and server recovery.

Since IPMI is completely independent of the operating system, monitoring, management, diagnostics and system recovery can be carried out even when the OS is frozen or the server is offline. IPMI technology implements functions to display notifications about the need to restore components - this makes it possible to monitor the state of the system and respond to possible hardware problems before they occur. The likelihood of such problems is also reduced by the hardware monitoring function. In addition, you can monitor tampering with the server hardware if you configure the IPMI system to detect openings of the enclosure. Personnel security is ensured by the use of multi-level rights and passwords in conjunction with identification and linear encryption technologies. Some IPMI 2.0 modules support KVM-over-Lan. This makes it possible to remotely log into the operating system on the server and perform the necessary manipulations to configure it, or to install and remove the necessary programs.

IPMI is easy to use because it usually comes already integrated into a server or a separate device. And most importantly, it does not require financial expenses. And allows you to control the system at those moments when software are powerless - for example, when the OS freezes. Thus, IPMI technology and existing facilities and management methods complement each other perfectly. And for effective management The server must use both software and hardware resources. -

Benefits of IPMI technology

• Remote control of power supplies, fans, voltage and temperature regardless of type and condition central processor and operating system
• Keeping a log of current events
• Support DOS, BIOS setup, Windows 2003, Linux
• Control of buttons on the body: Reset; Power down; Power up

Password protection

Altusen IP9001 and IPMI modules: embedded tools for remote computer management

Remote control modules, among which KVM switches are the most famous, are usually made in the form of external structures. But there is another class of devices, also designed for remote manipulation of server equipment, built directly into the controlled object. Every system administrator cannot imagine his activities without using remote access to ward servers, and in two versions: remote control equipment condition and remote execution of administrative functions. Typically, these tasks are solved by accessing a text console or a graphical shell desktop. It is possible to organize remote control in different ways, the most common of which are software tools. Almost every manufacturer of servers and storage systems includes software for remote status monitoring, notification of critical situations, and equipment administration.

Not least important are the built-in remote access tools provided by the OS, not counting individual third-party products. But sometimes software tools are powerless to help troubleshoot problems without direct access to the server. This happens, for example, when hardware failure, and only a “cold” restart or even the need to turn off/on the power can correct the situation. In such cases, a specialized hardware and software solution comes to the rescue, which is special controller, installed on the motherboard. Its power is provided from a standby source or even autonomously. It can be accessed via a network interface; in addition, there may be another channel - via a standalone COM port or modem. Such a controller has access to sensors on motherboard, and can also perform hardware reset and power on/off. These functions are managed from the administrator's workstation, on which a client is installed that interacts with the controllers and allows monitoring/control of a group of servers equipped with such modules.>

Altusen IP9001 The IP9001 controller is essentially a “computer within a computer.” This solution ensures complete hardware independence from the managed server. Access to the remote node is carried out via a Web interface and allows you to perform any operations with the computer being serviced, including turning on/off and hard reset The device is a PCI controller for remote control via the TCP/IP protocol, designed for installation in any computer equipped with the appropriate interface. In fact, IP9001 is an independent computer with its own IBM PowerPC 405GPr processor - a 400 MHz version of the already known 405GP, available with clock frequencies of 266 and 300 MHz. This processor includes an integrated PCI interface, SDRAM and Ethernet controllers. In addition to the required RAM and ROM, the board has its own ATI Rage XL graphics controller, and for connecting to the network it has an RJ-45 Ethernet port. Also worthy of attention is the possibility of working through telephone network using an additional modem module (RJ-11 connector) - it will help out if there is no access to the managed node via the local network. In addition to the above, the remote control module is equipped with a decent set of peripheral interfaces, including RS-232 and a USB 2.0 hub. The device is powered in two ways - through PCI bus and an external source designed to provide independence from the managed computer. Control from a remote console provides the operator with the full range of capabilities available directly from the server itself, including working in Remote Console mode, monitoring system voltage and temperature, turning on/off, and rebooting. Support virtual disk, CD and floppy drives allow you to install updates, software and boot the OS from media physically located on the remote workstation. The software allows support for 64 accounts with differentiated management access rights for each operator. The device is designed to use operating Windows systems 2000/2003/XP, Red Hat versions 8.0 and higher. IPMI (Intelligent Platform Management Interface).

Another type of embedded device designed exclusively for server platforms is based on a set of IPMI specifications developed by a group of manufacturing companies server equipment Intel, HP, NEC and Dell for remote monitoring/management tools. It included three specifications: Intelligent Platform Management Interface; Intelligent Platform Management Bus (IPMB) and Intelligent Chassis Management Bus (ICMB). IPMB - specification of the internal interface for advanced monitoring/control within a single system, ICMB defines the specifications external interface between IPMI-compatible systems.

IPMI extenders, despite their small size, provide full control over the server. After the release of version 1.0 in 1998, version 1.5 was released, and the 2.0 specification is currently relevant. This standard has already been supported by 171 equipment manufacturers, and the list continues to grow. Version 1.5 was approved in the first quarter of 2001. It already included the following features: means for monitoring temperatures, voltages, fan speeds, case tamper sensors; reset and power management; event logging; watchdog circuit (WatchDog Timer); access and notification via COM port and local network; specialized tires for monitoring. Version 2.0 was adopted in February 2004. It includes a number of additional features, such as Serial Over LAN, packet encryption, internal and external protocols, improved protection against unauthorized access, added extensions for monitoring modular structures (blade servers) and tools for creating virtual (management only) networks. Server motherboards were equipped with IPMI Intel platform 7500 for Xeon Prestonia with 400 MHz bus. It was an SMC-0001 module, compatible with IPMI-1.5, designed as a small board with a specialized processor and its own COM port in a design similar to SO-DIMM memory modules. Almost all boards on the Intel 7520/7525/7320 platform, as well as Intel 7221 for Pentium 4 is equipped with the AOC-IPMI20-E module, which is already compatible with IPMI 2.0.

IPMI architecture version 2.0. Today this is the main standard adopted by server system developers

On server platforms 7230 for Pentium D and 1U platforms of the 6014P series for Xeon, a new design for IPMI cards has appeared. It has a connector similar to PCI-X x16, only with an “inverted” key. These boards (AOC-1UIPMI-B and AOC-LPIPMI-LANG) are functionally similar to the AOC-IPMI20-E, but are equipped with an additional Intel 82541PI Gigabit network card. The AOC-LPIPMI-LANG module is designed for installation in a regular or 2U case, and the AOC-1UIPMI-B is designed for installation in a 1U case and is not equipped with a network card (it is optionally available as a separate AOC-1UIPMI-LANG module). By default, AOC-IPMI20-E uses the first network controller, available on the motherboard, and AOC-1UIPMI-B and AOC-LPIPMI-LANG - their additional one, if installed. When installed in the IPMI module, the Firmware corresponding to the motherboard is first programmed, and then the IP address is set. In the operating system the same network card can be used in parallel for other needs with an IP address different from that set for IPMI. As a rule, for security reasons, it is recommended to allocate a separate network to the latter. Used for monitoring/controlling systems with IPMI adapters special utility IPMIView20, which recognizes adapters of all versions. It allows you to find IPMI adapters in a given address range, and group the detected systems according to a certain criterion. To gain access to a specific server, it is necessary to pass password authentication, and IPMI 2.0 uses password control and encryption, as well as multi-level differentiation of access rights. Software for managing servers via IPMI provides the operator with not only a set of basic functions, but also monitoring data in a convenient graphical form The main monitoring/control capabilities provided by IPMI adapters, standards: logging system events, monitoring temperatures, voltages, fan speeds, and other sensors. It is possible to reboot, turn on/off and Cycle - sequentially turning off and then turning on the power. All these functions are available in two modes: Graceful Power Control - correct shutdown of the operating system through the agent installed on it (the GPC agent is available only for Windows and Linux), and Chassis Power Control - hardware reset/power off. Access to the text console is provided by reassigning it to a COM port and implementing SOL-redirection (Serial Over LAN). The latter allows you to access the text console of a remote server and change remotely, for example, BIOS settings. In the same way you can access the bootloader Windows menu or to the Linux/UNIX text console.

Afterword

The devices described in the review are designed to perform the same task - to simplify the maintenance of remote systems as much as possible. The main difference between them is the scope of application. While Altusen IP9001 is suitable for any system, the installation of IPMI modules is limited exclusively to server platforms. Today, many development companies strive to include such modules as part of their systems. So, on June 15, ATEN International Co. Ltd. announced that its new IPMI firmware solution has been officially selected by Micro-Star International Co. Ltd. (MSI) for its server product line. MSI will integrate the ATEN firmware solution into its line of AMD servers to provide customers with the necessary server management functions. Separately, it is worth noting that Supermicro is preparing new AOC-SIMLP IPMI 2.0 monitoring/management tools for the Bensley platform, which will have built-in KVM Over LAN capabilities via IPMI .