System Design Interview

The system design interview can be of two kinds:

Object Oriented / Data Model :

 

System Design :

 

References:

Advertisements

Things you do as a well rounded ML Engineer / Data Scientist

I came across this list somewhere on the web.

I felt the list nicely captures the different kinds of skills a well rounded ML Engineer/Data Scientist develops over his/her career:

Python Class Attributes

I recently came across this interesting article on class attributes v/s instance attributes in Python.

References:

Code:

 

Named Pipes. C# Python. .NET Core

I recently ran into issues  using the NamedPipeServerStream API  with .NET Core.

  • In Windows,  NamedPipeServerStream creates a pipe with a defined name in a specific location on the Windows filesystem (\\.pipe\\)
    • In a Python client application,  we were able to open this pipe for communication  using  the   code  snippet  :  open(r’\\.\pipe\\’ + pipe_name, ‘r+b’, 0)

 

  • However, on Linux,  the behavior for the NamedPipeServerStream API is different.
    • Looking at the source code for .NET Core,  I saw that NamedPipeServer/ClientStream in .NET Core are built on top of Unix domain sockets.
    • So, if we want to communicate with a Python client, we have to use Python’s socket module

Code:

 

References:

C# OutOfProcess Python

Using SSH Keys on Cloud Platforms

Azure:

  • openssl.exe req -x509 -nodes -days 365 -newkey rsa:2048 -keyout myPrivateKey.key -out myCert.pem
    • We will mostly use the .key file
    • The .pem file is only needed for Classic deployments. Typically we wont use this.

—-

  • Look up use of req : https://linux.die.net/man/1/req
    • The req command primarily creates and processes certificate requests . Thats why the output of req is a cerificate (myCert.pem)
    • But we are interested in the private key (myPrivateKey.key). Hence we are using the -keyout flag

References:

 

AWS:

  • In AWS,  the private key is saved in a .pem file . you just use the .pem file to connect to the instances.
    • Ideally the .pem extension is for certificates, not for keys.
    • This was one of my confusions – because AWS saves the key in the .pem file 

 

Tip:

  • Use ssh-agent to store private keys. Makes life much simpler!