Thursday, February 27, 2014

System.Runtime.Caching

Scenario

Continue from the previous post, the objective of my research is to find out a cache facility replacement for ASP.NET cache. The reason is when we use ASP.NET caching in WCF application, we are required to configure and turn on AspNetCompatibilityEnabled for your WCF service and that would deteriorate your WCF performance. Therefore, we want to avoid that happen by not having ASP.NET caching use in WCF.

AppFabric caching is one of the options, but it is overkill for a small-medium size application. Enterprise Library Caching Application Block is another option, however, I find that the latest Enterprise Library 6.0 no longer having Caching Application Block, checkout this article. From there, you will notice that Caching Application Block has been retired and replaced by System.Runtime.Caching classes which is available in .NET 4.0.

Implementation

In order to use the runtime caching in your application, go to your project and open up the "Add Reference" dialog, and then locate System.Runtime.Caching.


The main class library is MemoryCache, you can use the default cache engine when you start your application with the following code.

private static MemoryCache _cache;

static Program()
{
    _cache = MemoryCache.Default;

}

However, if you wish to use own custom cache engine, you can create your own custom caching provider by implementing the abstract ObjectCache.

Now, you may start playing around with the cache by stuffing object into it by using the MemoryCache Add or Set method. Add method is used to add cache item when there is no item in the cache. Set method is used if you want it to add item if it does not exist or replace item if it already exists.

private static void InitializeCache()
{
    //CountryList is my cache key name
    CacheItem cacheItem = new CacheItem("CountryList");
           
    List<Country> countries = new List<Country>();
    countries.Add(new Country() { ID = 1, Value = "Malaysia" });
    countries.Add(new Country() { ID = 2, Value = "Singapore" });
    countries.Add(new Country() { ID = 3, Value = "Thailand" });
    countries.Add(new Country() { ID = 4, Value = "Indonesia" });

    cacheItem.Value = countries;

    CacheItemPolicy cachePolicy = new CacheItemPolicy();

    //NOTE: Only can use/choose one between AbsoluteExpiration or SlidingExpiration
    //Absolute expiration mean clear cache after specific time
    cachePolicy.AbsoluteExpiration = DateTimeOffset.UtcNow.AddMinutes(10);

    //Sliding expiration mean clear cache if it has not been used after specific time
    //cachePolicy.SlidingExpiration = new TimeSpan(0, 5, 0); //5 mins

    //Priority Not Removable if you do not want the cache to be cleared
    cachePolicy.Priority = CacheItemPriority.NotRemovable;

    //NOTE: Only can use one UpdateCallback or RemovedCallback.
    //Fire the OnCacheUpdated event once the cache item has been modified
    //cachePolicy.UpdateCallback += OnCacheUpdated;

    //Fire the OnCacheRemoved event once the cache item has been removed
    cachePolicy.RemovedCallback += OnCacheRemoved;

    //Stuff the cache item and cache policy into the cache
    _cache.Set(cacheItem, cachePolicy);
}

When you use both AbsoluteExpiration and SlidingExpiration, you would get the following error:
AbsoluteExpiration must be DateTimeOffset.MaxValue or SlidingExpiration must be TimeSpan.Zero.

When you use both UpdateCallback and RemovedCallback, you would get the following error:
Only one callback can be specified.  Either RemovedCallback or UpdateCallback must be null.

The following are the callback method implementation:

private static void OnCacheRemoved(CacheEntryRemovedArguments arguments)
{
    Console.WriteLine("Somebody changed my cache! Or cache item evicted!");
    Console.WriteLine("Cache Item Removed - Key: " + arguments.CacheItem.Key);
    Console.WriteLine("Reason: " + arguments.RemovedReason.ToString());

    //Get the object which was removed.
    List<Country> countries = (List<Country>)arguments.CacheItem.Value;

    //Do what you want here after cache item is removed.
}

private static void OnCacheUpdated(CacheEntryUpdateArguments arguments)
{
    Console.WriteLine("Somebody changed my cache! Or cache item evicted!");
    Console.WriteLine("Cache Item Updated - Key: " + arguments.Key);

    //Get the object which was updated.
    List<Country> countries = (List<Country>)arguments.UpdatedCacheItem.Value;

    //Do what you want here after cache item is updated.

}

Now, you can play around with your cache item like updating or removing it, then it should fire the callback event which you had registered.

Change Monitor

The runtime cache also support change monitors which can hook up with the CacheItem callback events. There are 2 change monitors which are already available in the System.Runtime.Caching library:

  1. SqlChangeMonitor
  2. HostFileChangeMonitor
So, imagine that you have loaded your cache with the data from your database, in the mean time, you want your cache data always up to date base on the data in the database. You can use SqlChangeMonitor to monitor the database data change, then rely on SqlDependency to trigger the cache callback event if it detect changes. For more information how to implement this SqlChangeMonitor, please visit this great blog post.


For HostFileChangeMonitor, it is used to monitor any of your text file. If you cache data come from a text file, and if there is any change to the monitored text file, HostFileChangeMonitor will automatically trigger the cache callback event. Then, you can refresh your cache data by re-reading the text file.

So, here is how you use the change monitor:

CacheItemPolicy cachePolicy = new CacheItemPolicy();
HostFileChangeMonitor monitor = new HostFileChangeMonitor(new string[1] { "D:\\test.txt" });

cachePolicy.ChangeMonitors.Add(monitor);

Summary

System.Runtime.Caching class library is meant to provide caching facility for non web projects. Imagine we are still using ASP.NET caching, it is weird to have System.Web.dll reference in your non web project. Few years ago before .NET 4.0 was released and System.Runtime.Caching was not available yet, we have limited options and could only rely on 3rd party caching facility such as Enterprise Library.

This new cache also provide the somehow similar feature SqlCacheDependency which available in ASP.NET cache as the SqlChangeMonitor. And, a new feature with HostFileChangeMonitor which is not available in ASP.NET cache.

If you are interested with my source code, feel free to download it from HERE.







Saturday, February 15, 2014

AppFabric Caching

I have been given a task to research and find out any replacement for ASP.NET Cache. And, whether the cache can be used in any other application type besides web. I have done some research and comparison in AppFabric Caching, Enterprise Library Caching Application Block and System.Runtime.Caching. Today topic cover about AppFabric Caching, next post will cover about System.Runtime.Caching.

Scenario

Normally we are puzzled with which caching technology should we use and what are the differences between AppFabric cache compare to the other cache technology.

The caching feature that AppFabric provided is distributed cache, which mean it makes the cache available and accessible in one or many servers but they are unified into one entity for your application. When you are using ASP.NET cache or any caching facility, you notice that the cache is only available to your own application domain.

Image credit &source from : MSDN

Features

Comparing AppFabric cache vs ASP.NET cache, here are the differences and special features.

  1. The cache can be distributed hosting in one or multiple server.
  2. The cache can be hosted in a different standalone server, separate from Application server.
  3. The cache cluster promote high availability. If one of the cache server is down for some reason, the cache will still be available.
  4. The cache automatically sync data between cache hosts.

Configuration

After you have installed and start configuring the AppFabric, you would come across the following window in the wizard.


There are 2 Caching Service configuration provider, one is SQL Server and another is XML. If you wonder which provider to pick, it is depending on your environment. For my server, it is not joined with Active Directory (AD). Therefore, XML is my only option. If you forcefully pick SQL Server, you would get the following notification:


The provider difference is just the location of keeping cache cluster configuration. All the information that you enter in the "Next" page will be stored in SQL Server or a XML file.

Since I am using XML configuration provider, I have to create a new workgroup account to run the Caching Service. You are not allowed to use built-in account such as NT AUTHORITY\NETWORK SERVICE. The same workgroup account needs to be created in the other cache server, and applying same configuration.




Now, you need to pick one of your cache server to be a lead host, then create a network shared folder in that server. The network shared folder must be accessible by other hosts and giving the Cache Service account read/write privilege.



Once you are done with it, configure the File Share in AppFabric Configuration Wizard. Then, set the cluster size. If you are configuring the lead host, choose the New Cluster. For other cache host, choose the Join Cluster.


Next, the default TCP ports which will be used by AppFabric Cache Service are shown in the spinner box. Note them down and create firewall rule to unblock those ports. If you find any of these ports conflicting or is being used by any of you applicantion, you can change the port here.


That's it for AppFabric Cache configuration.

Usage

The cache usage is similar to ASP.NET cache. Open up Visual Studio, create any new project, then add the following assemblies.

C:\Program Files\AppFabric 1.1 for Windows Server\Microsoft.ApplicationServer.Caching.Core.dll
C:\Program Files\AppFabric 1.1 for Windows Server\Microsoft.ApplicationServer.Caching.Client.dll

Note: You need to manually browse and locate the above assemblies. If you add the references from the Assemblies Extension page, they are actually coming from Windows Azure SDK.


The following is the error that you will encounter if you added wrong assemblies:

ErrorCode<ERRCA0019>:SubStatus<ES0001>:Check the client version. It should be within the allowed version range on the server. If necessary, upgrade the client to the allowed version.

The following code need to be run once only to initialize the cache for your application:
Code credit to Scott Hanselman.

private static DataCacheFactory _factory = null;
private static DataCache _cache = null;

public static DataCache GetCache()
{
    if (_cache != null)
        return _cache;

    //List cache host server
    //Note: 22233 is the cache port
    List<DataCacheServerEndpoint> servers = new List<DataCacheServerEndpoint>();
    servers.Add(new DataCacheServerEndpoint("MY-SYLVESTER-01", 22233));
    servers.Add(new DataCacheServerEndpoint("MY-SYLVESTER-02", 22233));
    servers.Add(new DataCacheServerEndpoint("MY-SYLVESTER-03", 22233));
    servers.Add(new DataCacheServerEndpoint("MY-SYLVESTER-04", 22233));
    servers.Add(new DataCacheServerEndpoint("MY-SYLVESTER-05", 22233));

    //Set the cache hosts
    DataCacheFactoryConfiguration configuration = new DataCacheFactoryConfiguration();
    configuration.Servers = servers;
    configuration.LocalCacheProperties = new DataCacheLocalCacheProperties();

    //Set this if you want to get notified if any changes to your cache
    configuration.NotificationProperties = new DataCacheNotificationProperties(10000, new System.TimeSpan(0, 0, 3));
    //Default value for queue length: 10000
    //Default value for poll interval: 300 seconds

    //Disable tracing to avoid informational/verbose messages on the web page
    DataCacheClientLogManager.ChangeLogLevel(System.Diagnostics.TraceLevel.Off);

    //Pass configuration settings to cacheFactory constructor
    _factory = new DataCacheFactory(configuration);

    //Get reference to named cache called "default"
    _cache = _factory.GetCache("default");

    return _cache;

}

In order to insert data into the cache, just the following one liner:

public void SetData(string key, object data)
{
    _cache.Put(key, data);

}

In order to get the data from the cache, one liner as follow:

public object GetData(string key)
{
    return _cache.Get(key);

}

There are more complicated DataCache methods supported, check it out from MSDN.

Cache Notification

If you need the AppFabric Cache Service to notify you any changes to the cache, there are a few callback event can be subscribed. Before you can use this feature, you need to enable it during the cache initialization by setting the DataCacheNotificationProperties in DataCacheFactoryConfiguration.

Also, you need to enable notification by using this PowerShell command: 
Set-CacheConfig -CacheName <Cache Name> -NotificationsEnabled true

You also can change the AppFabric Cache configuration XML file in the shared folder.

Then, restart the cache cluster by restarting the AppFabric Caching Service windows service or executing the PowerShell command: Restart-CacheCluster

All the AppFabric Caching PowerShell command can be found HERE.


Now, I want to get notified when someone replace one of the cache item. The following is the code use to subscribe the callback method:

private static DataCache _cache;
       
static AppFabricCacheService ()
{
    _cache = CacheUtil.GetCache();

    _cache.AddItemLevelCallback(
        "myItem",
        DataCacheOperations.ReplaceItem,
        OnDataCacheItemChanged);
}

private static void OnDataCacheItemChanged(string cacheName, string regionName, string key, DataCacheItemVersion version, DataCacheOperations cacheOperation, DataCacheNotificationDescriptor nd)
{
    Debug.WriteLine("Someone changed my cache item!");
    Debug.WriteLine("Cache Name: " + cacheName);
    Debug.WriteLine("Cache Item Key: " + key);
}

If you want to get notified for other action to the cache, you can use different DataCacheOperations filter. More Info

You can use the bitwise OR to add more filter to your callback event subscription. For example, the following code will raise the OnDataCacheItemChanged callback method if someone add or replace or remove your cache item.

_cache.AddItemLevelCallback(
    "myItem",
    DataCacheOperations.AddItem |
    DataCacheOperations.ReplaceItem |
    DataCacheOperations.RemoveItem,
    OnDataCacheItemChanged);

AppFabric cache notification not just support cache item level notification, it also support for:

  • Cache level in bulk
  • Cache level
  • Item level
  • Region level


Note: These callback events are not supported in Windows Azure Shared Caching.

There are a few more things about AppFabric Caching, but it is too much to cover in one topic. The common and important thing that we need to know about caching such as security, concurrency, expiration and eviction, all can be found in this MSDN article.

Summary

The AppFabric caching is awesome, however, IMHO, if you are needing a simple cache that replace ASP.NET cache, AppFabric caching is overkill. Unless, you really need a caching service that support high availability, scalability, this is what you want.

AppFabric caching is meant to be hosted in different server from your application server. Therefore, hardware and software licensing needs to be considered. Otherwise, you can still choose to ignore the recommendation from Microsoft by hosting the AppFabric cache in the same server with your application server. Then, the server hardware resource could become the concern.

I notice that the AppFabric cache memory consumption is rather high compare to other normal caching facility. By default, the AppFabric caching will utilize 50% of your server memory. And, it is going to reserve quite some amount of memory even though you never have that much of data keeping in the cache or not. However, don't worry, the memory reserve can be tuned down by setting the high / low watermark percentage of memory in the cluster host configuration. See Windows Server AppFabric Memory Consumption Behavior for more info.

If you are looking for smaller caching facility and a replacement for ASP.NET cache for non web application, please come back and check out the next coming blog post.


Send Transactional SMS with API

This post cover how to send transactional SMS using the Alibaba Cloud Short Message Service API. Transactional SMS usually come with One Tim...