Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [nvme]

98 questions
17
votes
2 answers

Why is there both character device and block device for nvme?

I am trying to understand the configuration of nvme. But I do not understand why there are two devices: nvme block and nvme character device: crw------- 1 root root 243, 0 Dec 12 16:09 /dev/nvme0 brw-rw---- 1 root disk 259, 0 Jan 14 01:30…
GP92
  • 599
  • 2
  • 6
  • 25
17
votes
8 answers

Understanding NVMe storage and hardware requirements

I'm a bit confused about the recent developments in PCIe-based storage, particularly as it relates to the NVMe specification and its hardware compatibility. While I've worked extensively with SSDs in disk form-factor and some higher-end PCIe devices…
ewwhite
  • 194,921
  • 91
  • 434
  • 799
11
votes
3 answers

Automatically mount SSD instance storage on AWS EC2 in Ubuntu 16.04

I am using an Ubuntu 16.04 EC2 from AWS on c5d.2xlarge HW. It comes with a 200 GB SSD called /dev/nvme1n1. I am able to mount this drive using: $ sudo mkfs.ext4 -E nodiscard /dev/nvme1n1 $ sudo mount -o discard /dev/nvme1n1 /home/ubuntu To try…
John Corson
  • 113
  • 1
  • 6
8
votes
1 answer

The setup of S2D that delivers up to 2M IOPS to SQL FCI

We are about to deploy shared storage researching for ultra-fast storage to implement Microsoft SQL Server Failover Cluster (FCI). So far the project goes, we would to start with 500K IOPS for 8k blocks about 70r/30w pattern. Also we would like to…
Joshua Turnwell
  • 530
  • 3
  • 12
7
votes
0 answers

Write performance is 5 times worse with LUKS on top of mdadm RAID10 than without LUKS

I have servers with many NVMe disks. I am testing disk performance with fio using the following: fio --name=asdf --rw=randwrite --direct=1 --ioengine=libaio --bs=16k --numjobs=8 --size=10G --runtime=60 --group_reporting For a single disk, LUKS…
tacos_tacos_tacos
  • 3,220
  • 16
  • 58
  • 97
6
votes
3 answers

Disabling ext4 write barriers when using an external journal

I'm currently experimenting with different ways of improving write speeds to a fairly large, rotating disk-based, software-raid (mdadm) array on Debian using fast NVMe devices. I found that using a pair of such devices (raid1, mirrored) to store the…
jcharaoui
  • 322
  • 1
  • 12
6
votes
3 answers

What is the Long term stability of NVMe or SSD stored data?

Background: We need ready access to 30TB of audio data, although only a small fraction of it is ever requested for playback, that playback needs to be done immediately even for multi-year old data. The data resides in a SAN of multiple arrays and a…
Rowan Hawkins
  • 590
  • 2
  • 18
6
votes
3 answers

Very slow write speed (NVME drive) on 10G network

Setting up an experimental lab cluster, the write speed for data received via 10G fiber connection is 10% of the local write speeds. Testing transfer speed between two identical machines; iperf3 shows good memory to memory speed of 9.43Gbits/s. And…
roman
  • 191
  • 6
6
votes
3 answers

MongoDB on NVMe in production

I'm setting up my db production environment and I have some questions. The server has two NVMe disks, but they cannot be used in the hardware RAID controller. Do I need RAID with NVMe? Would it be enough to use them as JBOD in production? Or should…
Green
  • 163
  • 3
5
votes
3 answers

How to limit ZFS writes on NVME SSD in RAID1 to avoid rapid disk wear?

Currently I'm running Proxmox 5.3-7 on ZFS with few idling debian virtual machines. I'm using two SSDPE2MX450G7 NVME drives in RAID 1. After 245 days of running this setup the S.M.A.R.T values are terrible. SMART/Health Information (NVMe Log 0x02,…
Peter R.
  • 53
  • 1
  • 4
5
votes
1 answer

Does any PCIe slot support NVMe SSD's automatically or do I need a specific M.2 slot?

I have been trying to dissect the information I find with googling, but have come to the conclusion that I cannot find with certainty the answer to the following questions: Given you know the basics of your own desktop system, how do I know it…
Abel
  • 1,007
  • 8
  • 20
  • 32
5
votes
2 answers

Supermicro Server fails to boot from NVMe SSD

I have a SuperMicro server with an NVMe boot drive and an additional SSD for data. I was attempting to install ubuntu on the NVMe boot drive and even though the installation succeeds and the correct boot device is set in the BIOS, the server does…
Keno Fischer
  • 241
  • 1
  • 3
  • 8
5
votes
1 answer

Are my drives being utilized equally with Linux Software RAID 0 array?

I have four NVMe drives in a RAID 0 configuration. I am attempting to determine how many IOPS the array is handling. When I run iostat, it appears that one drive is handling more IO than the other three drives. Is this an error with the way that…
Vincent Saelzler
  • 51
  • 1
5
votes
2 answers

How to explain these fio bandwidth results?

Been running a couple of fio tests on a new server with the following setup: 1x Samsung PM981a 512GB M.2 NVMe drive. Proxmox installed with ZFS on root. 1x VM with 30GB space created and Debian 10 installed. 6x Intel P4510 2TB U.2 NVMe drives…
Woodgnome
  • 193
  • 6
4
votes
2 answers

Cannot connect to EC2 instance after converting Ubuntu 16 PV to Ubuntu 16 HVM

So it's been a few days and I still can not connect to my new HVM instance with EC2 running Ubuntu 16. For reference, I am trying to upgrade our server from an m3 instance running Ubuntu 16, to a C5 instance running Ubuntu 16. For almost every…
Alex
  • 221
  • 1
  • 7
1
2 3 4 5 6 7